-- Logs begin at Wed 2022-08-10 07:45:54 UTC, end at Wed 2022-08-10 09:03:50 UTC. -- Aug 10 08:21:58.694433 dv-cinder-781024-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 08:21:58.704397 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 08:21:58 2022] *** Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: nodename: dv-cinder-781024-3-iscsi Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: machine: x86_64 Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: clock source: unix Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: pcre jit disabled Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: detected number of CPU cores: 4 Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: current working directory: / Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: detected binary path: /usr/bin/uwsgi-core Aug 10 08:21:58.706414 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: your processes number limit is 47680 Aug 10 08:21:58.707076 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: your memory page size is 4096 bytes Aug 10 08:21:58.707076 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: detected max file descriptor number: 2048 Aug 10 08:21:58.707076 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: lock engine: pthread robust mutexes Aug 10 08:21:58.707076 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: thunder lock: enabled Aug 10 08:21:58.707076 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 08:21:58.707076 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 08:21:58.746193 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: Python main interpreter initialized at 0x5579f5db39c0 Aug 10 08:21:58.746193 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: python threads support enabled Aug 10 08:21:58.746193 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: your server socket listen backlog is limited to 100 connections Aug 10 08:21:58.746193 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: your mercy for graceful operations on workers is 90 seconds Aug 10 08:21:58.746549 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 08:21:58.746627 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: *** Operational MODE: preforking *** Aug 10 08:21:58.746899 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: *** uWSGI is running in multiple interpreter mode *** Aug 10 08:21:58.746899 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: spawned uWSGI master process (pid: 80404) Aug 10 08:21:58.747098 dv-cinder-781024-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 10 08:21:58.748146 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: spawned uWSGI worker 1 (pid: 80417, cores: 1) Aug 10 08:21:58.748146 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: spawned uWSGI worker 2 (pid: 80418, cores: 1) Aug 10 08:21:58.748146 dv-cinder-781024-3-iscsi devstack@keystone.service[80404]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 08:22:04.252965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:22:04.252965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: from cryptography.utils import int_from_bytes Aug 10 08:22:04.253731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:22:04.253731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: from cryptography.utils import int_from_bytes Aug 10 08:22:04.255345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:22:04.255345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: from cryptography.utils import int_from_bytes Aug 10 08:22:04.255815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:22:04.255815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: from cryptography.utils import int_from_bytes Aug 10 08:22:04.313705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 08:22:04.313891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 08:22:04.314016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 08:22:04.314121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] command line args: [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 08:22:04.314207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 08:22:04.314317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 08:22:04.314403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] command line args: [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 08:22:04.314502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ================================================================================ {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 08:22:04.314745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 08:22:04.314833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] admin_token = **** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315007 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ================================================================================ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 08:22:04.315101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] config_dir = [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] admin_token = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315523 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] config_source = [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315607 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] config_dir = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] debug = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] config_source = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.315962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.316198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] debug = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.316276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.316365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.316505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.316607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.316714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.316876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.316993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.317125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.317230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.317459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] list_limit = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.317671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] log_config_append = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.317893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.318090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] log_dir = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.318298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] log_file = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.318617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.318739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.318926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.319006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] log_config_append = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.319135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.319235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.319320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] log_dir = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.319447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] log_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.319530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.319750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.319931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.320215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.320342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.320502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.320582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.320831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.320954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.321092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.321213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.321288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.321415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.321500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.321678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.321782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.321982 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.322313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.322985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.323571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.323774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] publish_errors = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.324042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.324165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.324308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.324560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.324687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.324809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.324958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.325047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.325273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.325352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.325540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.325617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.325824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.325955 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] standard_threads = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.326142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.326315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.326448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.326568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] publish_errors = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.326681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.326889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] use_journal = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.327094 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] use_json = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.327300 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] use_stderr = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.327505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] use_syslog = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.327796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.328112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.328416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.328706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.328861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.328968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.329129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.329208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.329385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.329513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.329626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.329864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.329951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] standard_threads = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.330098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.330298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.330419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.330533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.330692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] use_journal = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.330831 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.330912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] use_json = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.331033 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] use_stderr = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.331210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] use_syslog = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.331314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.331444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:22:04.331661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.331740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.331929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.332006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.332192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.332331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.332417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.332671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.332748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.332908 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.332993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.333158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.333334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.333413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.333635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.333711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.333989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.334083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.334235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.334312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.334489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.334572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.334756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.334871 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.334975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.335196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.335273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.335456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.335541 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.335691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.335922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.336000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.336184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.336260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.336429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.336603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.336683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.336902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.336979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.337161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.337318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.337414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.337499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.337737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.337819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.338029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.338115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.338263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.338394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.338522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.338740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.338828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.338998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.339077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.339245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.339412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.339497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.339691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.339778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.339938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.340068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.340187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.340408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.340552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.340657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.340742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.340889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.341950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342648 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.342920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.343985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.344112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.344246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.344424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.344504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.344653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.344740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.344887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.344981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.345119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.345199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.345351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.345433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.345579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.345661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.345808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.345886 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.346048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.346130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.346282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.346364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.346529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.346629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.346771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.346860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347012 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.347946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.348024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.348199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.348276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.348444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.348532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.348688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.348768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.348923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349157 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.349946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.350084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.350173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.350318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.350402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.350572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.350665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.350808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.350889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.351040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.351119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.351272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.351351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.351504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.351584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.351762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.351892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.352943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.353024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.353178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.353257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.353411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.353490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.354156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.354238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.354387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.354502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.354636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.354714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.354867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.354948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.355095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.355173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.355322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.355399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.355563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.355645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.355799 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.355879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.356033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.356110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.356281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.356362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.356579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.356659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.356820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.356899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.357050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] auth.external = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.357130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.357280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.357359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.external = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.357509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.357587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.357792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.357880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] auth.password = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] auth.token = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.password = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.token = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.358964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.359977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.360131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.360212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] credential.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.360367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.360446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.360610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.360697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.360855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.360935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.361089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.361168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.361323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.361410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.361553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.361632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.361787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.361865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.362049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.362138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.362282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.362361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.362550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.362632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.362805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.362897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.363065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.363150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.363324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.363404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.363565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.363724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.363811 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.363886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] federation.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364756 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.364985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.365072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.365216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.365302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.365449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.365528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.365689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.365776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.365920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.366988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.367145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.367232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.367387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.367465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.367621 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.367700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.367854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.367942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.368088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.368166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.368316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.368395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.368552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.368641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.368787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.368866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.369034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.369119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.369816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.369918 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.370061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.370143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.370292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.370373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.370544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.370642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.370792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.370872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.371034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.371113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.371277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.371364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.371518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.371598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.371767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.371847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.372937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.373954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.374100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.374180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.374340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.374420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.374602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.374683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.374837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.374920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.375079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.375158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.375321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.375400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.375549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.375631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.375781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.375860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.376936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.377960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.378109 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.378189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.378337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.378418 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.378609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.378691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.378841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.378920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.379075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.379156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.379306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.379387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.379533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.379611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.379761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.379842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.380961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.381958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.382109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.382188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.382333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.382412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.382590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.382672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.382832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.382910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.383073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.383154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.383315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.383397 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.383556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.383636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.383783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.383875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.384978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.385058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.385220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.385308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.385466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.385545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.385694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.385773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.385939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.386961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.387117 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.387197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.387350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.387438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.387588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.387667 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.387818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.387898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] resource.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.388996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.389076 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.389230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.389308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.389476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.389564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.389708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.389788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.389943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] role.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] role.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.390987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] role.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.391127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.391205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] role.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.391364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.391443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.391606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.391694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.391849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.391930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.392092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.392171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.392331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.392419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.392575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.392654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.392816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.392894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.393059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.393149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.393287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.393366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.393530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.393608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.393769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.393856 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.394012 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.394092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.394254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.394333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.394517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.394676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.394911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.394990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.395145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.395267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.395388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.395470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.395743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.395824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.395991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.396071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.396223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.396305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.396461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.396540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.396713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.396791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.396949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.397948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.398119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.398199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.398367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.398447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.398627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.398710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.398861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.398952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.399086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.399173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.399315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.399395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] token.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.399548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.399630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] token.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.399782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.399862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.400993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.401072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.401230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.401310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.401471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.401549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.401702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.401780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.401936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.402972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.403134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.403222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.403374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.403460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.403665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.connection = **** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.403752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.403906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.403988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.404152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.404242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.404386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.404469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.404620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.404699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.404850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.404928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.405081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.405163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.405313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.405392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.405544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.405623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.405773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.405850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.406959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407495 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.407960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.408033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 08:22:04.408105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:22:04.408269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 08:22:04.437799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.438023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.438241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.438881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.439115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.448232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.449177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.476165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.476390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.477176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.477410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.529615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.530729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.581241 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.581441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.581551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.581680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.649144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.649368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.649588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.649804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.650017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.650148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.650242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.650381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.650630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.650849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.651064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.651277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.673332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.673564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.673787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.674003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.674214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.674424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.674656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.675545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.675879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.676199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.676522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.676808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.677088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.677366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.686118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.690538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.699455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.699688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.699907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.700123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.700335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.700545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.700756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.701737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.701963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.702185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.702404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.702643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.702859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.703091 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 08:22:04.717542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.717749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 08:22:04.717833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.717980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 08:22:04.718077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.718272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 08:22:04.718355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.718574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.718660 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 08:22:04.718836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.718933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.719090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.719173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.719341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.719423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.719599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.730868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.731036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.731169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.731304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.731440 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.731587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.731720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.731852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.738595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.738746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.741673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.741802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.741960 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.742088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.742244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.742381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.742533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.742661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.742819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.742952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.743092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.743234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.743365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.743509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.743639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.743769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.743908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.744040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.744652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.744776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.744905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.745054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.768451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.768609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.769924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.770056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.770211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.770351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.774846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.774980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.775127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.775210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.781953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.782065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.782140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.782241 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.782320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.782407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.786310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.786516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.786604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.786806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.786889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.787086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.787210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.787365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.787449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.787637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.787729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.787928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.788013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.788211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.788292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.788471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.804325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.804582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.804669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.804860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.809216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.809382 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.812576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.812664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.812870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.812952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.817342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.817618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.820558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.820832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.824329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826510 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.826953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.841951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.842236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.842342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.842583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.842668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.842796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.842905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.843061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.850047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.850162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.851623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.851715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.851899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.851983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.854790 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.854896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.855067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.855161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.855357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.855441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.855649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.855733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.855922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.856005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.867370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.867480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.867653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.867737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.867931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.868013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.868208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.868299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.868482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.868564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.868755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.868848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.869029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.869111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.886709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.886904 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.889677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.889869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.892659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.892837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.894243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.894413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.895774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.895927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.896065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.896207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.896346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.896496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.902850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.902990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.904441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.904597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.907404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.907547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.907692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.907834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.907976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.908123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.908258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.908400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.916432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.916579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.916720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.916866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.916999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.917147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.924080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.924197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 08:22:04.924401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.924492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.924661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.924746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.924909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.925003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.925174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.925256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.925456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.925542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.925722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.925895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.925985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.926050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.926343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.926433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.926628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.926722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.926902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.926986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.927165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.927257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.927442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.927524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.927701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.927782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 08:22:04.962338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579f5db39c0 pid: 80418 (default app) Aug 10 08:22:04.964322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579f5db39c0 pid: 80417 (default app) Aug 10 08:22:04.965678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9c126-291e-47be-888e-2c19feba591d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:04.965963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9c126-291e-47be-888e-2c19feba591d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:04.966231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9c126-291e-47be-888e-2c19feba591d None None] PATH_INFO: `/v3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:04.970635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Wed Aug 10 08:22:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:13.505590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7af01-a8b8-457d-a533-d00f9402a908 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:13.506152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7af01-a8b8-457d-a533-d00f9402a908 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:13.506152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7af01-a8b8-457d-a533-d00f9402a908 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:13.510545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:13.515765 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:13.516196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:13.516314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:13.586479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: INFO dbcounter [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] Registered counter for database keystone Aug 10 08:22:13.605771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG oslo_db.sqlalchemy.engines [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:22:13.612170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writer thread running {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:22:13.791974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG passlib.handlers.bcrypt [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80418) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 08:22:13.792313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG passlib.handlers.bcrypt [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80418) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 08:22:13.846669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:13.848286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:13.979351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 08:22:14.127448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7af01-a8b8-457d-a533-d00f9402a908 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:14.194935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: INFO dbcounter [None req-5fc7af01-a8b8-457d-a533-d00f9402a908 None None] Registered counter for database keystone Aug 10 08:22:14.215877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG oslo_db.sqlalchemy.engines [None req-5fc7af01-a8b8-457d-a533-d00f9402a908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:22:14.222395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writer thread running {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:22:14.344167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7af01-a8b8-457d-a533-d00f9402a908 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:14.348418 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f705914-b304-47af-9c07-7b21c5126cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:14.349034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f705914-b304-47af-9c07-7b21c5126cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:14.349306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f705914-b304-47af-9c07-7b21c5126cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:14.349574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f705914-b304-47af-9c07-7b21c5126cb6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:14.357994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f705914-b304-47af-9c07-7b21c5126cb6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:14.410073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f705914-b304-47af-9c07-7b21c5126cb6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 08:22:14.410348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f705914-b304-47af-9c07-7b21c5126cb6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:14.420360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Aug 10 08:22:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:22:14.426345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:14.440592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79917a-fd25-4e79-9322-672777fa9949 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:14.445038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4b87-0d85-4153-a642-7cd65750a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:14.446375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4b87-0d85-4153-a642-7cd65750a788 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:14.446375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4b87-0d85-4153-a642-7cd65750a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:14.446686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4b87-0d85-4153-a642-7cd65750a788 admin admin] PATH_INFO: `/v3/projects/4075a07229a44c19829adfecb306b6b7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:14.448376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b4b87-0d85-4153-a642-7cd65750a788 admin admin] RBAC: Authorizing `identity:get_project(project_id=4075a07229a44c19829adfecb306b6b7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:14.499517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba8b4b87-0d85-4153-a642-7cd65750a788 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 08:22:14.499857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b4b87-0d85-4153-a642-7cd65750a788 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:14.504413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Aug 10 08:22:14 2022] GET /identity/v3/projects/4075a07229a44c19829adfecb306b6b7 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:16.463535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb914f2-3252-47c8-a168-bdbb0617fc4f None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.464025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb914f2-3252-47c8-a168-bdbb0617fc4f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.464124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb914f2-3252-47c8-a168-bdbb0617fc4f None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.468727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:16.474154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911791-1e8d-48b4-9069-a3f8e4b969c2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.474594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911791-1e8d-48b4-9069-a3f8e4b969c2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.474724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911791-1e8d-48b4-9069-a3f8e4b969c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.495560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-74911791-1e8d-48b4-9069-a3f8e4b969c2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:16.497081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-74911791-1e8d-48b4-9069-a3f8e4b969c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:16.504871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 08:22:16.526531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb914f2-3252-47c8-a168-bdbb0617fc4f None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.539262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb914f2-3252-47c8-a168-bdbb0617fc4f None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.543464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f493a2-12fa-4685-a107-3170bee00943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.544374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f493a2-12fa-4685-a107-3170bee00943 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.544374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f493a2-12fa-4685-a107-3170bee00943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.544705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f493a2-12fa-4685-a107-3170bee00943 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.552514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f493a2-12fa-4685-a107-3170bee00943 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.554267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f493a2-12fa-4685-a107-3170bee00943 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.563137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Aug 10 08:22:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:22:16.568505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74911791-1e8d-48b4-9069-a3f8e4b969c2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:16.578230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74911791-1e8d-48b4-9069-a3f8e4b969c2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:16.582631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e9cd5-15f8-415c-9ee0-f15a48daf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:16.583244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e9cd5-15f8-415c-9ee0-f15a48daf64b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:16.583522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e9cd5-15f8-415c-9ee0-f15a48daf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:16.583794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e9cd5-15f8-415c-9ee0-f15a48daf64b admin admin] PATH_INFO: `/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:16.585122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e9cd5-15f8-415c-9ee0-f15a48daf64b admin admin] RBAC: Authorizing `identity:get_user(user_id=5a6ae8d3cbfd4ceca126228b9ed39b13)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:16.586980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e9cd5-15f8-415c-9ee0-f15a48daf64b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:16.588473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Wed Aug 10 08:22:16 2022] GET /identity/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:18.617744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89613d5-f1c7-44d9-9ba6-a4b50dffedbe None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:18.618283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89613d5-f1c7-44d9-9ba6-a4b50dffedbe None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:18.618283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89613d5-f1c7-44d9-9ba6-a4b50dffedbe None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:18.619613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:18.624752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab8b31-a860-498d-bbb8-fa10391c529c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:18.625179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab8b31-a860-498d-bbb8-fa10391c529c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:18.625301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab8b31-a860-498d-bbb8-fa10391c529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:18.633586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f87bcc-86cf-40ca-b6ff-39b0ffb8922a None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:18.633859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f87bcc-86cf-40ca-b6ff-39b0ffb8922a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:18.634122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f87bcc-86cf-40ca-b6ff-39b0ffb8922a None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:18.635411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:18.640824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:18.641102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:18.641365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:18.643484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-29ab8b31-a860-498d-bbb8-fa10391c529c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:18.644662 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-29ab8b31-a860-498d-bbb8-fa10391c529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:18.683428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG passlib.handlers.bcrypt [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80417) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 08:22:18.683845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG passlib.handlers.bcrypt [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80417) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 08:22:18.729764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:18.731393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:18.732178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:18.755074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab8b31-a860-498d-bbb8-fa10391c529c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:18.779313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:18.830791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:18.852531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:18.857122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab8b31-a860-498d-bbb8-fa10391c529c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:18.891329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606493aa-199f-4cf1-af18-2231bea38b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:18.891895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606493aa-199f-4cf1-af18-2231bea38b53 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:18.892167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606493aa-199f-4cf1-af18-2231bea38b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:18.892436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606493aa-199f-4cf1-af18-2231bea38b53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:18.903259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606493aa-199f-4cf1-af18-2231bea38b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-606493aa-199f-4cf1-af18-2231bea38b53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:18.912423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:18.913484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:18.914759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:18.919398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606493aa-199f-4cf1-af18-2231bea38b53 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:18.953596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da191-a57b-40fc-bad9-a4fab7406983 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:18.955876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:18.992650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2cb7a-95c7-4868-a61a-07bf14327a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:18.993511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2cb7a-95c7-4868-a61a-07bf14327a28 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:18.993784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2cb7a-95c7-4868-a61a-07bf14327a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:18.994051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2cb7a-95c7-4868-a61a-07bf14327a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:19.006871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:19.028489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606493aa-199f-4cf1-af18-2231bea38b53 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:19.061864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2cb7a-95c7-4868-a61a-07bf14327a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:19.063408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2cb7a-95c7-4868-a61a-07bf14327a28 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:19.063997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:19.064615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:19.064889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:19.065163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:19.065815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:19.066111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:19.067515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:19.079447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:19.084930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:19.165049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:22:19.170837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2cb7a-95c7-4868-a61a-07bf14327a28 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:19.173972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:19.271931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2cb7a-95c7-4868-a61a-07bf14327a28 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:19.289327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ec917-33cd-49db-93b6-d682d83dd128 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:19.306173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:19.307047 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:19.307327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:19.307594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:19.323137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdcc55-8cf8-46b0-85c2-633489faf7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:19.323784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdcc55-8cf8-46b0-85c2-633489faf7ba None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:19.324066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdcc55-8cf8-46b0-85c2-633489faf7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:19.324337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdcc55-8cf8-46b0-85c2-633489faf7ba None admin] PATH_INFO: `/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:19.325457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdcc55-8cf8-46b0-85c2-633489faf7ba None admin] RBAC: Authorizing `identity:get_user(user_id=5a6ae8d3cbfd4ceca126228b9ed39b13)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:19.326130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:19.326952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdcc55-8cf8-46b0-85c2-633489faf7ba None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:19.327619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:19.328518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:19 2022] GET /identity/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:19.333990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdcc55-8cf8-46b0-85c2-633489faf7ba None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:22:19.348168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:19.349138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:22:19.350191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:22:19.350191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:22:19.350191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:19.350454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:19.350571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:19.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:19.414935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:19.442399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdcc55-8cf8-46b0-85c2-633489faf7ba None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:19.459215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd69a-fa12-4251-92ed-18a47a7dfdae None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:19.476867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872428b7-8fc3-4c3a-aa72-805be57ae1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:19.477497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872428b7-8fc3-4c3a-aa72-805be57ae1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:19.477774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872428b7-8fc3-4c3a-aa72-805be57ae1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:19.478050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872428b7-8fc3-4c3a-aa72-805be57ae1d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:19.479187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872428b7-8fc3-4c3a-aa72-805be57ae1d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:19.481123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872428b7-8fc3-4c3a-aa72-805be57ae1d9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:19.482917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:19.488379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872428b7-8fc3-4c3a-aa72-805be57ae1d9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:19.491821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a6493-6850-472f-9b1d-d0cd1746381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:19.492425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6493-6850-472f-9b1d-d0cd1746381d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:19.492699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6493-6850-472f-9b1d-d0cd1746381d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:19.492964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6493-6850-472f-9b1d-d0cd1746381d None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:19.493600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a6493-6850-472f-9b1d-d0cd1746381d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:19.493895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a6493-6850-472f-9b1d-d0cd1746381d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:19.495301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a6493-6850-472f-9b1d-d0cd1746381d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:19.512901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:19.573294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:19.594005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872428b7-8fc3-4c3a-aa72-805be57ae1d9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:19.630587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfc89b-aa4f-4997-8ad7-59cda7cba602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:19.631267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfc89b-aa4f-4997-8ad7-59cda7cba602 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:19.631469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfc89b-aa4f-4997-8ad7-59cda7cba602 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:19.631738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfc89b-aa4f-4997-8ad7-59cda7cba602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:19.632479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfc89b-aa4f-4997-8ad7-59cda7cba602 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.domain.id=default, user.id=5a6ae8d3cbfd4ceca126228b9ed39b13) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:19.632786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfc89b-aa4f-4997-8ad7-59cda7cba602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:19.634243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfc89b-aa4f-4997-8ad7-59cda7cba602 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:19.641509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1322 bytes} [Wed Aug 10 08:22:19 2022] GET /identity/v3/role_assignments?user.id=5a6ae8d3cbfd4ceca126228b9ed39b13&scope.domain.id=default&role.id=45149274288845b0a73e18fbb3394202 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:21.735288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac82f2d-15c4-479b-988f-aa6dabe73bbd None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:21.736315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac82f2d-15c4-479b-988f-aa6dabe73bbd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:21.736808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac82f2d-15c4-479b-988f-aa6dabe73bbd None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:21.738370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:21.743962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e6361-955b-4e78-b1e2-ba9264527f23 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:21.744781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e6361-955b-4e78-b1e2-ba9264527f23 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:21.745281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e6361-955b-4e78-b1e2-ba9264527f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:21.764696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8b1e6361-955b-4e78-b1e2-ba9264527f23 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:21.766226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8b1e6361-955b-4e78-b1e2-ba9264527f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:21.847787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:21.883487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac82f2d-15c4-479b-988f-aa6dabe73bbd None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:21.992349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac82f2d-15c4-479b-988f-aa6dabe73bbd None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:22.015056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:22.034836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04672bb9-4b88-4667-9009-a13719a0e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:22.035608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672bb9-4b88-4667-9009-a13719a0e4cd None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.035892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672bb9-4b88-4667-9009-a13719a0e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.036170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672bb9-4b88-4667-9009-a13719a0e4cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.054556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04672bb9-4b88-4667-9009-a13719a0e4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-04672bb9-4b88-4667-9009-a13719a0e4cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:22.063924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:22.064767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:22.065522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 12/24] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:22.071013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e6361-955b-4e78-b1e2-ba9264527f23 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:22.092578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780335a2-9dfa-4edd-8a0c-4dc47dd32198 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.092864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780335a2-9dfa-4edd-8a0c-4dc47dd32198 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.093135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780335a2-9dfa-4edd-8a0c-4dc47dd32198 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.094635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 13/25] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:22.099545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9a05-f13c-42b5-bc06-bd685d1a1132 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.099852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9a05-f13c-42b5-bc06-bd685d1a1132 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.100097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9a05-f13c-42b5-bc06-bd685d1a1132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.131148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-fa9c9a05-f13c-42b5-bc06-bd685d1a1132 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:22.133185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fa9c9a05-f13c-42b5-bc06-bd685d1a1132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:22.219727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:22.266416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e6361-955b-4e78-b1e2-ba9264527f23 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:22.272124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 14/26] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:22.307104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9a05-f13c-42b5-bc06-bd685d1a1132 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:22.341281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:22.345046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.345340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.345676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.346373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:22.346761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:22.348178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:22.371355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 13/27] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:22.379800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:22.627557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9a05-f13c-42b5-bc06-bd685d1a1132 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:22.635125 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:22.662395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3d48-6587-41a1-8adc-1505d62c6ed8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:22.672758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4b20-8209-45b7-a8b2-0f774258edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:22.673639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4b20-8209-45b7-a8b2-0f774258edb0 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.674106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4b20-8209-45b7-a8b2-0f774258edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.674598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4b20-8209-45b7-a8b2-0f774258edb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.675553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e4b20-8209-45b7-a8b2-0f774258edb0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:22.677123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e4b20-8209-45b7-a8b2-0f774258edb0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:22.705837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d87a6-2dd9-415b-a12a-3cff543d4109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:22.706937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d87a6-2dd9-415b-a12a-3cff543d4109 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.707412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d87a6-2dd9-415b-a12a-3cff543d4109 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.707896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d87a6-2dd9-415b-a12a-3cff543d4109 None admin] PATH_INFO: `/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.709262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d87a6-2dd9-415b-a12a-3cff543d4109 None admin] RBAC: Authorizing `identity:get_user(user_id=5a6ae8d3cbfd4ceca126228b9ed39b13)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:22.711041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d87a6-2dd9-415b-a12a-3cff543d4109 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:22.712934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 14/28] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:22 2022] GET /identity/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13 => generated 247 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:22.714340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7057b-78db-4ed1-bef3-fe78a0467117 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.714838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7057b-78db-4ed1-bef3-fe78a0467117 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.715348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7057b-78db-4ed1-bef3-fe78a0467117 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.717030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 15/29] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:22.721886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7057b-78db-4ed1-bef3-fe78a0467117 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:22.726783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:22.832135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7057b-78db-4ed1-bef3-fe78a0467117 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:22.867882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53480e7-b00c-4560-bfbc-3bff2977a4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:22.868881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53480e7-b00c-4560-bfbc-3bff2977a4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.869350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53480e7-b00c-4560-bfbc-3bff2977a4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.869811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53480e7-b00c-4560-bfbc-3bff2977a4d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.871669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53480e7-b00c-4560-bfbc-3bff2977a4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:22.873282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53480e7-b00c-4560-bfbc-3bff2977a4d0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:22.875140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 16/30] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:22.876445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ab0d-3095-4add-8203-d6c37b856d9b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.876925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ab0d-3095-4add-8203-d6c37b856d9b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.877398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9ab0d-3095-4add-8203-d6c37b856d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.896164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6fa9ab0d-3095-4add-8203-d6c37b856d9b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:22.897629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6fa9ab0d-3095-4add-8203-d6c37b856d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:22.916531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 15/31] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 10 08:22:22 2022] POST /identity/v3/roles => generated 219 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:22:22.918090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b84f-2d9e-4f32-9e38-1eb75a9fe5e6 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:22.918372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b84f-2d9e-4f32-9e38-1eb75a9fe5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:22.918681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b84f-2d9e-4f32-9e38-1eb75a9fe5e6 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:22.928846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 16/32] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:22.929829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6b84f-2d9e-4f32-9e38-1eb75a9fe5e6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:23.010256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 17/33] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:23.014690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda329fe-a895-4a87-8aba-f8c3c31d5e84 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.015000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda329fe-a895-4a87-8aba-f8c3c31d5e84 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.015275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda329fe-a895-4a87-8aba-f8c3c31d5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.030825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:23.050398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bda329fe-a895-4a87-8aba-f8c3c31d5e84 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:23.052499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bda329fe-a895-4a87-8aba-f8c3c31d5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:23.127057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6b84f-2d9e-4f32-9e38-1eb75a9fe5e6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:23.152731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 18/34] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:23.153904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda329fe-a895-4a87-8aba-f8c3c31d5e84 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:23.168450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267abd9-6205-4c57-a468-226dc8c2dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:23.169113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267abd9-6205-4c57-a468-226dc8c2dc1e None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.169391 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267abd9-6205-4c57-a468-226dc8c2dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.169664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267abd9-6205-4c57-a468-226dc8c2dc1e None admin] PATH_INFO: `/v3/domains/default/users/5a6ae8d3cbfd4ceca126228b9ed39b13/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.173178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267abd9-6205-4c57-a468-226dc8c2dc1e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5a6ae8d3cbfd4ceca126228b9ed39b13, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:23.175296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267abd9-6205-4c57-a468-226dc8c2dc1e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:23.263148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda329fe-a895-4a87-8aba-f8c3c31d5e84 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:23.283104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 17/35] 10.222.0.45 () {58 vars in 1361 bytes} [Wed Aug 10 08:22:22 2022] PUT /identity/v3/domains/default/users/5a6ae8d3cbfd4ceca126228b9ed39b13/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:23.284859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5ff5-b061-4d35-a219-39abc659ff1b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.285451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5ff5-b061-4d35-a219-39abc659ff1b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.286200 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5ff5-b061-4d35-a219-39abc659ff1b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.288385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:23.289715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd5ff5-b061-4d35-a219-39abc659ff1b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:23.301183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:23.301183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f49f-5535-49b9-a811-1c4e50b01add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:23.303751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f49f-5535-49b9-a811-1c4e50b01add None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.304206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f49f-5535-49b9-a811-1c4e50b01add None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.304621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f49f-5535-49b9-a811-1c4e50b01add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.318244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f49f-5535-49b9-a811-1c4e50b01add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:23.320123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f49f-5535-49b9-a811-1c4e50b01add None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:23.334760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9a77f49f-5535-49b9-a811-1c4e50b01add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:22:23.339848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:23.340937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:22:23.341953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:22:23.341953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:22:23.341953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:23.343817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 19/37] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:23.345580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2ea5-b8c7-472a-bdc7-59d9eb8e0fbd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.346148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2ea5-b8c7-472a-bdc7-59d9eb8e0fbd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.346658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2ea5-b8c7-472a-bdc7-59d9eb8e0fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.368583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-269f2ea5-b8c7-472a-bdc7-59d9eb8e0fbd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:23.370354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-269f2ea5-b8c7-472a-bdc7-59d9eb8e0fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:23.417981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd5ff5-b061-4d35-a219-39abc659ff1b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:23.450240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 20/38] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:23.451615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f2ea5-b8c7-472a-bdc7-59d9eb8e0fbd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:23.457646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73df29-17aa-4691-ad98-aa929f6bebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:23.458269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73df29-17aa-4691-ad98-aa929f6bebf8 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.459400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73df29-17aa-4691-ad98-aa929f6bebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.459400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73df29-17aa-4691-ad98-aa929f6bebf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.459650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73df29-17aa-4691-ad98-aa929f6bebf8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:23.461030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73df29-17aa-4691-ad98-aa929f6bebf8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:23.559124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f2ea5-b8c7-472a-bdc7-59d9eb8e0fbd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:23.574715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:23.575649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 10 08:22:23 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:23.587691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73df29-17aa-4691-ad98-aa929f6bebf8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:23.599280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac8b2d-92c5-4f7b-aaea-09d19cf41757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:23.600212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac8b2d-92c5-4f7b-aaea-09d19cf41757 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.600678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac8b2d-92c5-4f7b-aaea-09d19cf41757 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.601836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac8b2d-92c5-4f7b-aaea-09d19cf41757 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.602803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac8b2d-92c5-4f7b-aaea-09d19cf41757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:23.603261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac8b2d-92c5-4f7b-aaea-09d19cf41757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:23.608723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac8b2d-92c5-4f7b-aaea-09d19cf41757 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:23.632310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 21/40] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:23.634782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d70c-7cff-4234-99b9-62b39f3a7fa8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.635075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d70c-7cff-4234-99b9-62b39f3a7fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.635350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d70c-7cff-4234-99b9-62b39f3a7fa8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.638400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 22/41] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:23.639378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2d70c-7cff-4234-99b9-62b39f3a7fa8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:23.707901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:23.732132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73df29-17aa-4691-ad98-aa929f6bebf8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:23.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2d70c-7cff-4234-99b9-62b39f3a7fa8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:23.783548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbc928-b6cb-443a-a0b4-7427864cef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:23.784115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc928-b6cb-443a-a0b4-7427864cef6b None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.784395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc928-b6cb-443a-a0b4-7427864cef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.784669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc928-b6cb-443a-a0b4-7427864cef6b None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.785826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbc928-b6cb-443a-a0b4-7427864cef6b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:23.787271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbc928-b6cb-443a-a0b4-7427864cef6b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:23.816106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278a96e-be3e-4fec-bd5d-3e2a6a0e12c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:23.816734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a96e-be3e-4fec-bd5d-3e2a6a0e12c1 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.817008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a96e-be3e-4fec-bd5d-3e2a6a0e12c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.817305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a96e-be3e-4fec-bd5d-3e2a6a0e12c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.818005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278a96e-be3e-4fec-bd5d-3e2a6a0e12c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:23.819880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278a96e-be3e-4fec-bd5d-3e2a6a0e12c1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:23.860780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 20/42] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 10 08:22:23 2022] POST /identity/v3/roles => generated 223 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:23.862217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3080c-ff6e-4eee-b639-b78627e58c80 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:23.862529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3080c-ff6e-4eee-b639-b78627e58c80 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:23.862805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3080c-ff6e-4eee-b639-b78627e58c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:23.882239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bbc3080c-ff6e-4eee-b639-b78627e58c80 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:23.883868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bbc3080c-ff6e-4eee-b639-b78627e58c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:23.987664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 21/43] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:24.017025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3080c-ff6e-4eee-b639-b78627e58c80 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:24.033257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:22:23 2022] POST /identity/v3/projects => generated 301 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:24.114126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:24.138059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3080c-ff6e-4eee-b639-b78627e58c80 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:24.175788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf0be1-b935-451f-95ac-eee416a43633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:24.176445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf0be1-b935-451f-95ac-eee416a43633 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:24.176733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf0be1-b935-451f-95ac-eee416a43633 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:24.177010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf0be1-b935-451f-95ac-eee416a43633 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:24.178175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf0be1-b935-451f-95ac-eee416a43633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:24.179978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf0be1-b935-451f-95ac-eee416a43633 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:24.182162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 22/45] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:24.188275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278a96e-be3e-4fec-bd5d-3e2a6a0e12c1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:24.218587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:24.291629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278a96e-be3e-4fec-bd5d-3e2a6a0e12c1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:24.325867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae21f27-015f-444e-a073-d17c3a66bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:24.326500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21f27-015f-444e-a073-d17c3a66bd10 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:24.326782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21f27-015f-444e-a073-d17c3a66bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:24.327053 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21f27-015f-444e-a073-d17c3a66bd10 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:24.327703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21f27-015f-444e-a073-d17c3a66bd10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:24.329275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21f27-015f-444e-a073-d17c3a66bd10 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:24.433706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:22:24 2022] POST /identity/v3/projects => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:25.333674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a5f0-0cf6-424d-85f4-ec8d8d89ec1f None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:25.334159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a5f0-0cf6-424d-85f4-ec8d8d89ec1f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:25.334159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a5f0-0cf6-424d-85f4-ec8d8d89ec1f None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:25.335526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 23/47] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:25.340816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a80442-ca4f-4227-833c-ecda57d10cce None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:25.341233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a80442-ca4f-4227-833c-ecda57d10cce None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:25.341364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a80442-ca4f-4227-833c-ecda57d10cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:25.359753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f1a80442-ca4f-4227-833c-ecda57d10cce None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:25.361272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f1a80442-ca4f-4227-833c-ecda57d10cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:25.426305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 25/48] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:25.449379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a5f0-0cf6-424d-85f4-ec8d8d89ec1f None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:25.549700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a5f0-0cf6-424d-85f4-ec8d8d89ec1f None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:25.582838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53898-9504-49f2-be4e-b88332b56b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:25.583453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53898-9504-49f2-be4e-b88332b56b66 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:25.583777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53898-9504-49f2-be4e-b88332b56b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:25.583998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53898-9504-49f2-be4e-b88332b56b66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:25.594342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d53898-9504-49f2-be4e-b88332b56b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f2d53898-9504-49f2-be4e-b88332b56b66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:25.599014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:25.599842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:25.600627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 24/49] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:25.606391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a80442-ca4f-4227-833c-ecda57d10cce None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:25.616404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:25.702297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a80442-ca4f-4227-833c-ecda57d10cce None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:25.735557 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:25.736192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:25.736473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:25.736749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:25.737418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:25.737723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:25.739146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:25.747005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 26/50] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:25.752476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53898-9504-49f2-be4e-b88332b56b66 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:25.757470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:25.849799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d53898-9504-49f2-be4e-b88332b56b66 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:25.883005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ea803-2e8f-4efc-82e7-af04b5e6b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:25.883626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ea803-2e8f-4efc-82e7-af04b5e6b930 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:25.883906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ea803-2e8f-4efc-82e7-af04b5e6b930 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:25.884179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ea803-2e8f-4efc-82e7-af04b5e6b930 None admin] PATH_INFO: `/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:25.885300 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ea803-2e8f-4efc-82e7-af04b5e6b930 None admin] RBAC: Authorizing `identity:get_user(user_id=5a6ae8d3cbfd4ceca126228b9ed39b13)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:25.886799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ea803-2e8f-4efc-82e7-af04b5e6b930 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:25.888364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 25/51] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:25 2022] GET /identity/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:25.893759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:25.964753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:25.994459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749e7bb-00cc-4e8c-9395-5f0d0c3243c9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:26.027851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad45fb-dd50-4f30-a10f-30b53f90faf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:26.028483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad45fb-dd50-4f30-a10f-30b53f90faf9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.028764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad45fb-dd50-4f30-a10f-30b53f90faf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.029038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad45fb-dd50-4f30-a10f-30b53f90faf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.030152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad45fb-dd50-4f30-a10f-30b53f90faf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:26.031643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad45fb-dd50-4f30-a10f-30b53f90faf9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:26.033224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 27/52] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:26.038975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ea803-2e8f-4efc-82e7-af04b5e6b930 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:26.106704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:26.134561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ea803-2e8f-4efc-82e7-af04b5e6b930 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:26.168638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc100-0649-4b45-bb26-6e6eb927f2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:26.169234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc100-0649-4b45-bb26-6e6eb927f2fb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.169512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc100-0649-4b45-bb26-6e6eb927f2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.169781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc100-0649-4b45-bb26-6e6eb927f2fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.170524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc100-0649-4b45-bb26-6e6eb927f2fb None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.domain.id=default, user.id=5a6ae8d3cbfd4ceca126228b9ed39b13) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:26.170828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc100-0649-4b45-bb26-6e6eb927f2fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:26.172267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc100-0649-4b45-bb26-6e6eb927f2fb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:26.180276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1322 bytes} [Wed Aug 10 08:22:26 2022] GET /identity/v3/role_assignments?user.id=5a6ae8d3cbfd4ceca126228b9ed39b13&scope.domain.id=default&role.id=45149274288845b0a73e18fbb3394202 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:26.434939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448077b-3fea-4dbb-ae21-e8658f71b7e2 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.435425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448077b-3fea-4dbb-ae21-e8658f71b7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.435508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448077b-3fea-4dbb-ae21-e8658f71b7e2 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.436816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 28/54] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:26.441906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b01550-56b1-48c8-928f-bcc59efce52a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.442335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b01550-56b1-48c8-928f-bcc59efce52a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.442456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b01550-56b1-48c8-928f-bcc59efce52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.460262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-56b01550-56b1-48c8-928f-bcc59efce52a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:26.461442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-56b01550-56b1-48c8-928f-bcc59efce52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:26.524158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 27/55] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:26.547426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448077b-3fea-4dbb-ae21-e8658f71b7e2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:26.644050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448077b-3fea-4dbb-ae21-e8658f71b7e2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:26.676573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399edc5-32e5-4bca-8f90-92bceb231568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:26.677182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399edc5-32e5-4bca-8f90-92bceb231568 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.677457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399edc5-32e5-4bca-8f90-92bceb231568 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.677722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399edc5-32e5-4bca-8f90-92bceb231568 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.678839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399edc5-32e5-4bca-8f90-92bceb231568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:26.680260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399edc5-32e5-4bca-8f90-92bceb231568 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:26.681769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 29/56] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:26.687376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b01550-56b1-48c8-928f-bcc59efce52a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:26.754327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:26.787583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b01550-56b1-48c8-928f-bcc59efce52a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:26.819581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072e78a-bbf6-4513-acfc-194e61113191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:26.820175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e78a-bbf6-4513-acfc-194e61113191 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:26.820454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e78a-bbf6-4513-acfc-194e61113191 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:26.820729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e78a-bbf6-4513-acfc-194e61113191 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:26.821372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072e78a-bbf6-4513-acfc-194e61113191 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:26.823103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072e78a-bbf6-4513-acfc-194e61113191 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:26.907081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 28/57] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Aug 10 08:22:26 2022] POST /identity/v3/projects => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:22:28.868612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823a20-c49b-41d9-bd42-3e04e7d4a05d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:28.869126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823a20-c49b-41d9-bd42-3e04e7d4a05d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:28.869208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823a20-c49b-41d9-bd42-3e04e7d4a05d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:28.870540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 30/58] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:28.875617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6eec-3311-4d7f-b39c-8a96fe7fb303 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:28.875975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6eec-3311-4d7f-b39c-8a96fe7fb303 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:28.876169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6eec-3311-4d7f-b39c-8a96fe7fb303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:28.893760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-c0ef6eec-3311-4d7f-b39c-8a96fe7fb303 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:28.894983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c0ef6eec-3311-4d7f-b39c-8a96fe7fb303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:28.960609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 29/59] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:28.984925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05823a20-c49b-41d9-bd42-3e04e7d4a05d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:28.993638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:29.083149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05823a20-c49b-41d9-bd42-3e04e7d4a05d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:29.115214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24848e92-ecf0-4bd5-be0e-b03465d0810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:29.115826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848e92-ecf0-4bd5-be0e-b03465d0810f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:29.116101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848e92-ecf0-4bd5-be0e-b03465d0810f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:29.116367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848e92-ecf0-4bd5-be0e-b03465d0810f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:29.117456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24848e92-ecf0-4bd5-be0e-b03465d0810f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:29.118967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24848e92-ecf0-4bd5-be0e-b03465d0810f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:29.120473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 31/60] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:29.125849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef6eec-3311-4d7f-b39c-8a96fe7fb303 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:29.172690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:29.221166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef6eec-3311-4d7f-b39c-8a96fe7fb303 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:29.253950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2792b2-a793-4b15-b0ee-e89897ad21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:29.254563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2792b2-a793-4b15-b0ee-e89897ad21c4 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:29.254841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2792b2-a793-4b15-b0ee-e89897ad21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:29.255109 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2792b2-a793-4b15-b0ee-e89897ad21c4 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:29.255740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2792b2-a793-4b15-b0ee-e89897ad21c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:29.257186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2792b2-a793-4b15-b0ee-e89897ad21c4 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:29.391865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 30/61] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:22:29 2022] POST /identity/v3/users => generated 275 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:32.324877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797404-362a-468f-a239-51785375712a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.325962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797404-362a-468f-a239-51785375712a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.326440 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797404-362a-468f-a239-51785375712a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.328021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 32/62] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:32.333145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480885-bf51-452a-8744-30823d81a4e7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.333945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480885-bf51-452a-8744-30823d81a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.334428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480885-bf51-452a-8744-30823d81a4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.360356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-5f480885-bf51-452a-8744-30823d81a4e7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:32.361874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5f480885-bf51-452a-8744-30823d81a4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:32.448550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 31/63] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:32.492278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797404-362a-468f-a239-51785375712a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:32.602944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:32.636233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797404-362a-468f-a239-51785375712a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:32.671050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29ac5-a284-44c8-a3e7-eb2d974ba662 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.671689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29ac5-a284-44c8-a3e7-eb2d974ba662 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.672211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29ac5-a284-44c8-a3e7-eb2d974ba662 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.673732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 32/64] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:32.679145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05050787-f855-4192-826d-38479c39e5cf None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.680131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05050787-f855-4192-826d-38479c39e5cf None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.681065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05050787-f855-4192-826d-38479c39e5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.686535 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537a41-33e6-4ec7-98d4-2fb7f90293d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:32.687423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537a41-33e6-4ec7-98d4-2fb7f90293d9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.687928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537a41-33e6-4ec7-98d4-2fb7f90293d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.688388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537a41-33e6-4ec7-98d4-2fb7f90293d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.711776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3537a41-33e6-4ec7-98d4-2fb7f90293d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f3537a41-33e6-4ec7-98d4-2fb7f90293d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:32.717437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:32.718286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:32.719113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:32.721207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-05050787-f855-4192-826d-38479c39e5cf None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:32.722634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-05050787-f855-4192-826d-38479c39e5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:32.724000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 33/65] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:32.735446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537a41-33e6-4ec7-98d4-2fb7f90293d9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:32.784588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:32.856135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 33/66] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:32.864243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59abb1-68fe-4576-9556-8b7253714080 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.864757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59abb1-68fe-4576-9556-8b7253714080 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.865339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59abb1-68fe-4576-9556-8b7253714080 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.867286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 34/67] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:32.874035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f14b2-0b81-401e-83c0-2ded14bf6ffd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.874539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f14b2-0b81-401e-83c0-2ded14bf6ffd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.874984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f14b2-0b81-401e-83c0-2ded14bf6ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.888627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537a41-33e6-4ec7-98d4-2fb7f90293d9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:32.905857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f54f14b2-0b81-401e-83c0-2ded14bf6ffd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:32.907603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f54f14b2-0b81-401e-83c0-2ded14bf6ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:32.925942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:32.927034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.927314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.927583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.928257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:32.928561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:32.929958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:32.931384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:32.945486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 34/68] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:32.945486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:32.990430 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 35/69] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:32.992028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab2ad3-2433-4a42-a672-4565d37cb9ef None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:32.992492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab2ad3-2433-4a42-a672-4565d37cb9ef None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:32.992940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab2ad3-2433-4a42-a672-4565d37cb9ef None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:32.994692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 36/70] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:32.995576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab2ad3-2433-4a42-a672-4565d37cb9ef None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.068566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50745a-e508-4ce9-8f8e-1a11fde474a9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.104153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb32a2-1958-4ab4-8d50-bf662eb6944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.104803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb32a2-1958-4ab4-8d50-bf662eb6944b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.105118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb32a2-1958-4ab4-8d50-bf662eb6944b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.105389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb32a2-1958-4ab4-8d50-bf662eb6944b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.116575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb32a2-1958-4ab4-8d50-bf662eb6944b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bedb32a2-1958-4ab4-8d50-bf662eb6944b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:33.122130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:33.128274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:33.129105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112e77d-12a3-4171-aef0-6dbc009f98f4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.129781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112e77d-12a3-4171-aef0-6dbc009f98f4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.129781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112e77d-12a3-4171-aef0-6dbc009f98f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.143969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7112e77d-12a3-4171-aef0-6dbc009f98f4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:33.145162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7112e77d-12a3-4171-aef0-6dbc009f98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:33.146548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:33.153930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab2ad3-2433-4a42-a672-4565d37cb9ef None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.187594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b435fc-4782-4d44-b0be-e2602908b48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.188234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b435fc-4782-4d44-b0be-e2602908b48d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.188536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b435fc-4782-4d44-b0be-e2602908b48d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.188776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b435fc-4782-4d44-b0be-e2602908b48d None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.195541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:33.205739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b435fc-4782-4d44-b0be-e2602908b48d None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:33.207259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b435fc-4782-4d44-b0be-e2602908b48d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:33.208973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 37/72] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:32 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:33.209733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b435fc-4782-4d44-b0be-e2602908b48d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.215431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 36/73] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:33.215431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112e77d-12a3-4171-aef0-6dbc009f98f4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.315374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b435fc-4782-4d44-b0be-e2602908b48d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.315576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112e77d-12a3-4171-aef0-6dbc009f98f4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.349414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf703d7-3cd1-4c42-87eb-0e3bd8d51c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.350086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf703d7-3cd1-4c42-87eb-0e3bd8d51c49 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.350225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36b5d3-e6ec-4ace-9a89-382a55fea5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.350659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf703d7-3cd1-4c42-87eb-0e3bd8d51c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.350659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf703d7-3cd1-4c42-87eb-0e3bd8d51c49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.350852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36b5d3-e6ec-4ace-9a89-382a55fea5df None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.351134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36b5d3-e6ec-4ace-9a89-382a55fea5df None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.351408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36b5d3-e6ec-4ace-9a89-382a55fea5df None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.352071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36b5d3-e6ec-4ace-9a89-382a55fea5df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:33.352376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36b5d3-e6ec-4ace-9a89-382a55fea5df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:33.353766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36b5d3-e6ec-4ace-9a89-382a55fea5df None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:33.360422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf703d7-3cd1-4c42-87eb-0e3bd8d51c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:33.362072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 37/74] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:33.363186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d844f-60a3-4730-886b-24c0c8bd798d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.363478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d844f-60a3-4730-886b-24c0c8bd798d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.363758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d844f-60a3-4730-886b-24c0c8bd798d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.369149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 38/75] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-8cf703d7-3cd1-4c42-87eb-0e3bd8d51c49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:33.369288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:33.370083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:33.371426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:33.372004 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d844f-60a3-4730-886b-24c0c8bd798d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.372079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 38/76] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:22:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:33.372079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf703d7-3cd1-4c42-87eb-0e3bd8d51c49 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.383464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:33.420972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:33.469759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf703d7-3cd1-4c42-87eb-0e3bd8d51c49 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.475828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d844f-60a3-4730-886b-24c0c8bd798d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.507224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086533-d043-431e-bbdd-1ec3f5bde79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.507882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086533-d043-431e-bbdd-1ec3f5bde79f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.508163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086533-d043-431e-bbdd-1ec3f5bde79f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.508666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086533-d043-431e-bbdd-1ec3f5bde79f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.509575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086533-d043-431e-bbdd-1ec3f5bde79f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:33.511075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086533-d043-431e-bbdd-1ec3f5bde79f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:33.512671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 39/77] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:33.513143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78d137-c2ba-4f7d-b87f-d7b79cc330c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.513433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086533-d043-431e-bbdd-1ec3f5bde79f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.513749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78d137-c2ba-4f7d-b87f-d7b79cc330c8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.514025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78d137-c2ba-4f7d-b87f-d7b79cc330c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.514327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78d137-c2ba-4f7d-b87f-d7b79cc330c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.593229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78d137-c2ba-4f7d-b87f-d7b79cc330c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:33.594792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78d137-c2ba-4f7d-b87f-d7b79cc330c8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:33.600284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:33.624007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086533-d043-431e-bbdd-1ec3f5bde79f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.649641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:33.664415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cd46d-3f63-4383-96cc-6ee9e37511fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.665112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd46d-3f63-4383-96cc-6ee9e37511fc None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.665390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd46d-3f63-4383-96cc-6ee9e37511fc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.665664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd46d-3f63-4383-96cc-6ee9e37511fc None admin] PATH_INFO: `/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.666848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cd46d-3f63-4383-96cc-6ee9e37511fc None admin] RBAC: Authorizing `identity:get_user(user_id=5a6ae8d3cbfd4ceca126228b9ed39b13)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:33.668831 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cd46d-3f63-4383-96cc-6ee9e37511fc None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:33.670443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 40/78] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:33 2022] GET /identity/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:33.674976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb7ec-6ba4-47c7-8efc-2df47bf0f9af None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.674976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb7ec-6ba4-47c7-8efc-2df47bf0f9af None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.674976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb7ec-6ba4-47c7-8efc-2df47bf0f9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.690692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-135cb7ec-6ba4-47c7-8efc-2df47bf0f9af None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:33.691903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-135cb7ec-6ba4-47c7-8efc-2df47bf0f9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:33.708672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 39/79] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:33.709521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78d137-c2ba-4f7d-b87f-d7b79cc330c8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.761238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 41/80] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:33.762047 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cb7ec-6ba4-47c7-8efc-2df47bf0f9af None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.807333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78d137-c2ba-4f7d-b87f-d7b79cc330c8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.840816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.841416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.841699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.841973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.842695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:33.843002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:33.844392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:33.850530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:33.852172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 40/81] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:22:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:33.852791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.869088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:33.872961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cb7ec-6ba4-47c7-8efc-2df47bf0f9af None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.907481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a34143-c7cb-47ec-b416-435e3222b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.908050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a34143-c7cb-47ec-b416-435e3222b1c8 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.908357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a34143-c7cb-47ec-b416-435e3222b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.908633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a34143-c7cb-47ec-b416-435e3222b1c8 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:33.909275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a34143-c7cb-47ec-b416-435e3222b1c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:33.910771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a34143-c7cb-47ec-b416-435e3222b1c8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:33.953822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b554c-fdbd-4228-949c-5dd8b3e96c61 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:33.984728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 42/82] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:22:33 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:33.985380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a34143-c7cb-47ec-b416-435e3222b1c8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:33.988649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa187c-6fab-4b8a-badf-c7954fd7ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:33.990250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa187c-6fab-4b8a-badf-c7954fd7ce2f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:33.990721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa187c-6fab-4b8a-badf-c7954fd7ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:33.990907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa187c-6fab-4b8a-badf-c7954fd7ce2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:34.082427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa187c-6fab-4b8a-badf-c7954fd7ce2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:34.084147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa187c-6fab-4b8a-badf-c7954fd7ce2f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:34.097769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:34.109641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a34143-c7cb-47ec-b416-435e3222b1c8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:34.155205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c3451-16c1-4c0d-bd6a-3e50df539c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:34.155849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c3451-16c1-4c0d-bd6a-3e50df539c87 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:34.156670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c3451-16c1-4c0d-bd6a-3e50df539c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:34.156670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c3451-16c1-4c0d-bd6a-3e50df539c87 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:34.158575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c3451-16c1-4c0d-bd6a-3e50df539c87 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:34.159981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c3451-16c1-4c0d-bd6a-3e50df539c87 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:34.161565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 43/83] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:33 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:34.162416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c3451-16c1-4c0d-bd6a-3e50df539c87 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:34.165366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:34.206815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 41/84] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:34.212301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa187c-6fab-4b8a-badf-c7954fd7ce2f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:34.291674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c3451-16c1-4c0d-bd6a-3e50df539c87 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:34.338217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa187c-6fab-4b8a-badf-c7954fd7ce2f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:34.339185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e440e-a0bd-4f11-b361-8182735b0c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:34.339963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e440e-a0bd-4f11-b361-8182735b0c55 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:34.340244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e440e-a0bd-4f11-b361-8182735b0c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:34.340511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e440e-a0bd-4f11-b361-8182735b0c55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:34.351469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:34.354795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e440e-a0bd-4f11-b361-8182735b0c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-b99e440e-a0bd-4f11-b361-8182735b0c55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:34.361011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:34.368647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 44/85] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:34.369629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e440e-a0bd-4f11-b361-8182735b0c55 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:34.382135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e14af-ba82-403e-baed-ad1edee29dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:34.383000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e14af-ba82-403e-baed-ad1edee29dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:34.383368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e14af-ba82-403e-baed-ad1edee29dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:34.383718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e14af-ba82-403e-baed-ad1edee29dc0 None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:34.385066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e14af-ba82-403e-baed-ad1edee29dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:34.386689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e14af-ba82-403e-baed-ad1edee29dc0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:34.388658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 42/86] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:34 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:34.389514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e14af-ba82-403e-baed-ad1edee29dc0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:34.434971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:34.477762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e440e-a0bd-4f11-b361-8182735b0c55 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:34.501277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e14af-ba82-403e-baed-ad1edee29dc0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:34.517103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:34.518067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:34.518586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:34.519168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:34.520309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] RBAC: Adding query filter params (role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=33df3de83e2f4538b39277107129f1fb, user.id=1c8a150ece2241cb8d50235feaf78b41) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:34.520928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:34.522718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:34.528895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 45/87] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:34 2022] GET /identity/v3/role_assignments?user.id=1c8a150ece2241cb8d50235feaf78b41&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=4851e677104948daa4c8bcf195bd8608 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:34.530145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:34.539417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b9d3-84a1-4973-8e51-86f20023a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:34.540081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b9d3-84a1-4973-8e51-86f20023a6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:34.540364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b9d3-84a1-4973-8e51-86f20023a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:34.540637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b9d3-84a1-4973-8e51-86f20023a6d5 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:34.541885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b9d3-84a1-4973-8e51-86f20023a6d5 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:34.544078 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b9d3-84a1-4973-8e51-86f20023a6d5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:34.545797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 43/88] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:34 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:34.551791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b9d3-84a1-4973-8e51-86f20023a6d5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:34.606097 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:34.682497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b9d3-84a1-4973-8e51-86f20023a6d5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:34.726798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f297-2da3-42de-889b-75681c99db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:34.727433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f297-2da3-42de-889b-75681c99db3d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:34.727717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f297-2da3-42de-889b-75681c99db3d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:34.728019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f297-2da3-42de-889b-75681c99db3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:34.733246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01412d00-c8e8-40c4-81bf-745023086bca None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:34.804377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:34.809254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f297-2da3-42de-889b-75681c99db3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:34.811030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f297-2da3-42de-889b-75681c99db3d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:34.829747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:34.830827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:34.831437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:34.833050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:34.834272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:34.835500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:34.837378 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:34.862495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 46/89] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:34.864333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:34.903003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:35.002478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae39a6-1aa1-4d6f-bf7c-df20020c3a86 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:35.039697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:35.040305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:35.040625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:35.040897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:35.041636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=33df3de83e2f4538b39277107129f1fb, user.id=5a6ae8d3cbfd4ceca126228b9ed39b13) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:35.041943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:35.043605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:35.049776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 47/90] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:34 2022] GET /identity/v3/role_assignments?user.id=5a6ae8d3cbfd4ceca126228b9ed39b13&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=45149274288845b0a73e18fbb3394202 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:35.050911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:35.114882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:35.117732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 44/91] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:35.126207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f297-2da3-42de-889b-75681c99db3d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:35.173648 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993d99-d488-4f4f-ae95-1fa85f584981 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:35.222063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703b27-4325-4fa4-8b20-6ef05d9bb2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:35.222776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703b27-4325-4fa4-8b20-6ef05d9bb2eb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:35.223057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703b27-4325-4fa4-8b20-6ef05d9bb2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:35.223829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703b27-4325-4fa4-8b20-6ef05d9bb2eb None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:35.225222 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f703b27-4325-4fa4-8b20-6ef05d9bb2eb None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:35.226853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f703b27-4325-4fa4-8b20-6ef05d9bb2eb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:35.229182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 48/92] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:35 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:35.235080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703b27-4325-4fa4-8b20-6ef05d9bb2eb None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:35.367780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f297-2da3-42de-889b-75681c99db3d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:35.404409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46e4e9-d6f7-4625-9eb0-9e7194031b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:35.405050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46e4e9-d6f7-4625-9eb0-9e7194031b55 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:35.405333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46e4e9-d6f7-4625-9eb0-9e7194031b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:35.405613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46e4e9-d6f7-4625-9eb0-9e7194031b55 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:35.406785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46e4e9-d6f7-4625-9eb0-9e7194031b55 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:35.408273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46e4e9-d6f7-4625-9eb0-9e7194031b55 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:35.410226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 45/93] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:35 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:35.416238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46e4e9-d6f7-4625-9eb0-9e7194031b55 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:35.420481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703b27-4325-4fa4-8b20-6ef05d9bb2eb None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:35.448715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:35.456624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:35.487312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c26f-a070-464e-83c7-1cad15e7b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:35.487932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c26f-a070-464e-83c7-1cad15e7b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:35.488212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c26f-a070-464e-83c7-1cad15e7b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:35.488472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c26f-a070-464e-83c7-1cad15e7b1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:35.583024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46e4e9-d6f7-4625-9eb0-9e7194031b55 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:35.614922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1c26f-a070-464e-83c7-1cad15e7b1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:35.616517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1c26f-a070-464e-83c7-1cad15e7b1c9 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:35.622537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:35.623103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:35.624261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:35.624551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:35.625304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] RBAC: Adding query filter params (role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=33df3de83e2f4538b39277107129f1fb, user.id=1c8a150ece2241cb8d50235feaf78b41) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:35.625618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:35.627117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:35.633972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 46/94] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:35 2022] GET /identity/v3/role_assignments?user.id=1c8a150ece2241cb8d50235feaf78b41&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:35.768721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 49/95] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:22:35.774630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:35.876741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:35.903153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76d343-909a-4471-a986-bf1326911b61 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:35.950810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678cc7d-11b9-49e8-9fdc-0af9c974440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:35.951463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678cc7d-11b9-49e8-9fdc-0af9c974440b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:35.951747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678cc7d-11b9-49e8-9fdc-0af9c974440b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:35.952023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678cc7d-11b9-49e8-9fdc-0af9c974440b None admin] PATH_INFO: `/v3/projects/e91a9535b7ec482eab1e44d6653b6aaa` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:35.957552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678cc7d-11b9-49e8-9fdc-0af9c974440b None admin] RBAC: Authorizing `identity:get_project(project_id=e91a9535b7ec482eab1e44d6653b6aaa)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:35.959051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678cc7d-11b9-49e8-9fdc-0af9c974440b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:35.960707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 47/96] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:35 2022] GET /identity/v3/projects/e91a9535b7ec482eab1e44d6653b6aaa => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:35.967194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c26f-a070-464e-83c7-1cad15e7b1c9 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:35.990018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:36.110034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c26f-a070-464e-83c7-1cad15e7b1c9 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:36.151303 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24e152-5860-4e20-9631-0f6127b0e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:36.152327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e152-5860-4e20-9631-0f6127b0e5be None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:36.152844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e152-5860-4e20-9631-0f6127b0e5be None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:36.153326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e152-5860-4e20-9631-0f6127b0e5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:36.154249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24e152-5860-4e20-9631-0f6127b0e5be None admin] RBAC: Adding query filter params (role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=e91a9535b7ec482eab1e44d6653b6aaa, user.id=1c8a150ece2241cb8d50235feaf78b41) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:36.154780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24e152-5860-4e20-9631-0f6127b0e5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:36.156406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24e152-5860-4e20-9631-0f6127b0e5be None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:36.162454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 50/97] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:35 2022] GET /identity/v3/role_assignments?user.id=1c8a150ece2241cb8d50235feaf78b41&scope.project.id=e91a9535b7ec482eab1e44d6653b6aaa&role.id=4851e677104948daa4c8bcf195bd8608 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:36.772396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e441b-374f-4010-ac4a-b4c4b890b95b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:36.772903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e441b-374f-4010-ac4a-b4c4b890b95b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:36.772977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e441b-374f-4010-ac4a-b4c4b890b95b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:36.774306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 48/98] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:36.779555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef5d3-821b-410d-b91e-76c0ab10ae44 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:36.780003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef5d3-821b-410d-b91e-76c0ab10ae44 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:36.780177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef5d3-821b-410d-b91e-76c0ab10ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:36.804129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-482ef5d3-821b-410d-b91e-76c0ab10ae44 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:36.805352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-482ef5d3-821b-410d-b91e-76c0ab10ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:36.877192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 51/99] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:36.900122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e441b-374f-4010-ac4a-b4c4b890b95b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:37.015329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e441b-374f-4010-ac4a-b4c4b890b95b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:37.051817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab98f5-fe0c-4677-8bc1-76ee4a63932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:37.052384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab98f5-fe0c-4677-8bc1-76ee4a63932e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.052668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab98f5-fe0c-4677-8bc1-76ee4a63932e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.052943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab98f5-fe0c-4677-8bc1-76ee4a63932e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.054078 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab98f5-fe0c-4677-8bc1-76ee4a63932e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:37.055637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab98f5-fe0c-4677-8bc1-76ee4a63932e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:37.057257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 49/100] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:37.063070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef5d3-821b-410d-b91e-76c0ab10ae44 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:37.086450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:37.222183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef5d3-821b-410d-b91e-76c0ab10ae44 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:37.228334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d790-2f65-45b7-9c40-688d14ecfb06 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.228626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d790-2f65-45b7-9c40-688d14ecfb06 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.228897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d790-2f65-45b7-9c40-688d14ecfb06 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.230283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 50/101] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:37.236736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30997875-b916-44b6-add1-6f8d3edf498e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.237027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30997875-b916-44b6-add1-6f8d3edf498e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.237306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30997875-b916-44b6-add1-6f8d3edf498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.262247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f513-16cc-45e5-8ec0-5985f08d75fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:37.262891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f513-16cc-45e5-8ec0-5985f08d75fe None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.263169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f513-16cc-45e5-8ec0-5985f08d75fe None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.263443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f513-16cc-45e5-8ec0-5985f08d75fe None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.264104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17f513-16cc-45e5-8ec0-5985f08d75fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:37.265570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17f513-16cc-45e5-8ec0-5985f08d75fe None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:37.287554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-30997875-b916-44b6-add1-6f8d3edf498e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:37.288778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-30997875-b916-44b6-add1-6f8d3edf498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:37.318653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:37.368897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 52/102] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:22:37 2022] POST /identity/v3/projects => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:37.370157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aafe0f-57fc-41c7-9d90-f9d32c24ae04 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.370493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aafe0f-57fc-41c7-9d90-f9d32c24ae04 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.370954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aafe0f-57fc-41c7-9d90-f9d32c24ae04 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.372168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 53/103] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:37.394951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 51/104] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:37.400034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8910-6bb8-48ff-9145-5908c01dd90b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.400327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8910-6bb8-48ff-9145-5908c01dd90b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.400577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8910-6bb8-48ff-9145-5908c01dd90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.419611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30997875-b916-44b6-add1-6f8d3edf498e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:37.443644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1bcf8910-6bb8-48ff-9145-5908c01dd90b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:37.444895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1bcf8910-6bb8-48ff-9145-5908c01dd90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:37.560689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30997875-b916-44b6-add1-6f8d3edf498e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:37.575083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:37.587974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 54/105] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:37.598679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a6a4c-74e1-4256-aa12-c3e94180c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:37.599386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a6a4c-74e1-4256-aa12-c3e94180c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.599740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a6a4c-74e1-4256-aa12-c3e94180c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.600023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a6a4c-74e1-4256-aa12-c3e94180c3a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.611094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a6a4c-74e1-4256-aa12-c3e94180c3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1d6a6a4c-74e1-4256-aa12-c3e94180c3a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:37.616209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:37.617113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:37.618296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 52/106] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:37.624341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf8910-6bb8-48ff-9145-5908c01dd90b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:37.624479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a6a4c-74e1-4256-aa12-c3e94180c3a5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:37.629063 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:37.770179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a6a4c-74e1-4256-aa12-c3e94180c3a5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:37.790150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf8910-6bb8-48ff-9145-5908c01dd90b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:37.829650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f665679-ae19-42ba-9b09-7ce96f9e4418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:37.830164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665679-ae19-42ba-9b09-7ce96f9e4418 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.830416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665679-ae19-42ba-9b09-7ce96f9e4418 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.830739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665679-ae19-42ba-9b09-7ce96f9e4418 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.843251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f665679-ae19-42ba-9b09-7ce96f9e4418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8f665679-ae19-42ba-9b09-7ce96f9e4418 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:37.848399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:37.850106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:37.851363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 53/107] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:37.856653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f665679-ae19-42ba-9b09-7ce96f9e4418 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:37.891790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:37.892765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:37.893236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:37.893692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:37.894675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:37.895171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:37.901347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:37.914522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 55/108] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:37.920812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:37.926400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:37.971753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f665679-ae19-42ba-9b09-7ce96f9e4418 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:38.014091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:38.014948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.015229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.015554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.016236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:38.016542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:38.018016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:38.029661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 54/109] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:38.031115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:38.035891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:38.114684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0485b0-171e-44a9-9d04-c0a360a65ffb None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:38.153328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6b1a4-ab01-42bc-89ca-0bb7ec30e066 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:38.177840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42e6d8-8dc6-4634-9da4-f023215c1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:38.178499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e6d8-8dc6-4634-9da4-f023215c1353 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.178992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e6d8-8dc6-4634-9da4-f023215c1353 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.179272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e6d8-8dc6-4634-9da4-f023215c1353 None admin] PATH_INFO: `/v3/users/870f7d9de55b4484934c0054adc3aa51` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.186683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:38.191793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d9a4d-e2ed-467d-8c7a-b915d388c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:38.192434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d9a4d-e2ed-467d-8c7a-b915d388c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.192767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d9a4d-e2ed-467d-8c7a-b915d388c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.193042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d9a4d-e2ed-467d-8c7a-b915d388c1f1 None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.194259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d9a4d-e2ed-467d-8c7a-b915d388c1f1 None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:38.196183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d9a4d-e2ed-467d-8c7a-b915d388c1f1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:38.198344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 55/110] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:38 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:38.204727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d9a4d-e2ed-467d-8c7a-b915d388c1f1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:38.212948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42e6d8-8dc6-4634-9da4-f023215c1353 None admin] RBAC: Authorizing `identity:get_user(user_id=870f7d9de55b4484934c0054adc3aa51)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:38.216721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42e6d8-8dc6-4634-9da4-f023215c1353 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:38.222953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 56/111] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:37 2022] GET /identity/v3/users/870f7d9de55b4484934c0054adc3aa51 => generated 289 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:38.229312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42e6d8-8dc6-4634-9da4-f023215c1353 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:38.376709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d9a4d-e2ed-467d-8c7a-b915d388c1f1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:38.434319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0ceb5-6e83-4878-a4ca-f71fa03c46b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:38.434994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0ceb5-6e83-4878-a4ca-f71fa03c46b2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.435273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0ceb5-6e83-4878-a4ca-f71fa03c46b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.435543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0ceb5-6e83-4878-a4ca-f71fa03c46b2 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.436101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42e6d8-8dc6-4634-9da4-f023215c1353 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:38.436700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0ceb5-6e83-4878-a4ca-f71fa03c46b2 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:38.438258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0ceb5-6e83-4878-a4ca-f71fa03c46b2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:38.440181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 56/112] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:38 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:38.441294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b2f2-ffc2-4c0d-9e71-ba876d419c3b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.441543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b2f2-ffc2-4c0d-9e71-ba876d419c3b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.441814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b2f2-ffc2-4c0d-9e71-ba876d419c3b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.443074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 57/113] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:38.451390 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b2f2-ffc2-4c0d-9e71-ba876d419c3b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:38.470894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:38.485672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204c7a7-3fb4-4c63-b7cf-f9804a4a4bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:38.487325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c7a7-3fb4-4c63-b7cf-f9804a4a4bcb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.487642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c7a7-3fb4-4c63-b7cf-f9804a4a4bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.487918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c7a7-3fb4-4c63-b7cf-f9804a4a4bcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.543208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:38.580657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204c7a7-3fb4-4c63-b7cf-f9804a4a4bcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:38.583070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204c7a7-3fb4-4c63-b7cf-f9804a4a4bcb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:38.592293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b2f2-ffc2-4c0d-9e71-ba876d419c3b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:38.636646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627748b-f765-4812-873c-fed1e1eae01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:38.637231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627748b-f765-4812-873c-fed1e1eae01d None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.637511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627748b-f765-4812-873c-fed1e1eae01d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.637783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627748b-f765-4812-873c-fed1e1eae01d None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb/users/1c8a150ece2241cb8d50235feaf78b41/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.640184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627748b-f765-4812-873c-fed1e1eae01d None admin] RBAC: Authorizing `identity:create_grant(project_id=33df3de83e2f4538b39277107129f1fb, user_id=1c8a150ece2241cb8d50235feaf78b41, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:38.642028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627748b-f765-4812-873c-fed1e1eae01d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:38.704062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 57/114] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:38.705742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2f0a-5c66-454c-b97d-00d850ab44c0 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.706226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2f0a-5c66-454c-b97d-00d850ab44c0 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.706667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2f0a-5c66-454c-b97d-00d850ab44c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.710446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 58/115] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:38 2022] PUT /identity/v3/projects/33df3de83e2f4538b39277107129f1fb/users/1c8a150ece2241cb8d50235feaf78b41/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:38.722665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1f4c-1abd-46c3-b493-c78860559037 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.724324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1f4c-1abd-46c3-b493-c78860559037 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.724794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1f4c-1abd-46c3-b493-c78860559037 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.728501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 59/116] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:38 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:38.731522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab1f4c-1abd-46c3-b493-c78860559037 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:38.747444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d41e2f0a-5c66-454c-b97d-00d850ab44c0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:38.750579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d41e2f0a-5c66-454c-b97d-00d850ab44c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:38.803918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:38.905950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 58/117] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:38.907974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90f6b-beae-4cf4-bcac-8151f5a926eb None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.908408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90f6b-beae-4cf4-bcac-8151f5a926eb None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.909074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90f6b-beae-4cf4-bcac-8151f5a926eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.930114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-64c90f6b-beae-4cf4-bcac-8151f5a926eb None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:38.932524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-64c90f6b-beae-4cf4-bcac-8151f5a926eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:38.945932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab1f4c-1abd-46c3-b493-c78860559037 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:38.977695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:38.993983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0308-1105-40de-80e0-5b999d11b356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:38.994745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0308-1105-40de-80e0-5b999d11b356 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:38.995136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0308-1105-40de-80e0-5b999d11b356 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:38.997785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0308-1105-40de-80e0-5b999d11b356 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:38.997785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f0308-1105-40de-80e0-5b999d11b356 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:38.998498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f0308-1105-40de-80e0-5b999d11b356 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:39.000795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 60/118] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:38 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:39.001723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0308-1105-40de-80e0-5b999d11b356 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:39.015866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 59/119] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:39.016972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90f6b-beae-4cf4-bcac-8151f5a926eb None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:39.160787 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:39.185428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0308-1105-40de-80e0-5b999d11b356 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:39.209140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90f6b-beae-4cf4-bcac-8151f5a926eb None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:39.224347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0c757-537c-48c7-b59b-cdef821b4594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:39.225369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c757-537c-48c7-b59b-cdef821b4594 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.225962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c757-537c-48c7-b59b-cdef821b4594 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.226499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c757-537c-48c7-b59b-cdef821b4594 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.238261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0c757-537c-48c7-b59b-cdef821b4594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c7a0c757-537c-48c7-b59b-cdef821b4594 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:39.244226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:39.245066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:39.245880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:39.248262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 61/120] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:39.249457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0c757-537c-48c7-b59b-cdef821b4594 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:39.267535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:39.270051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.271521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.271893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.272990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] RBAC: Adding query filter params (role.id=09d6cbb5feda48f389570c916edfda07, scope.project.id=33df3de83e2f4538b39277107129f1fb, user.id=870f7d9de55b4484934c0054adc3aa51) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:39.273306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:39.274856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:39.282573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 60/121] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/role_assignments?user.id=870f7d9de55b4484934c0054adc3aa51&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=09d6cbb5feda48f389570c916edfda07 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:39.284411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:39.324009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:39.381835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0c757-537c-48c7-b59b-cdef821b4594 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:39.423444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a107-2c89-4c8b-ae5a-5e13811123d6 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:39.441126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740af2de-41a0-47b5-8946-0727f8544f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:39.443081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af2de-41a0-47b5-8946-0727f8544f13 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.443364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af2de-41a0-47b5-8946-0727f8544f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.444428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740af2de-41a0-47b5-8946-0727f8544f13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.475914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740af2de-41a0-47b5-8946-0727f8544f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-740af2de-41a0-47b5-8946-0727f8544f13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:39.481954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:39.482887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:39.483665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 62/122] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:39.484792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224df7b-07d0-4e88-be72-4b2b6140bcb5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.485081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224df7b-07d0-4e88-be72-4b2b6140bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.485396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224df7b-07d0-4e88-be72-4b2b6140bcb5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.488195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 63/123] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:39.491768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224df7b-07d0-4e88-be72-4b2b6140bcb5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:39.492451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55c18b-c6f7-4672-aad5-3b1349a7c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:39.493340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c18b-c6f7-4672-aad5-3b1349a7c52d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.493801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c18b-c6f7-4672-aad5-3b1349a7c52d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.494252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c18b-c6f7-4672-aad5-3b1349a7c52d None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.495560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55c18b-c6f7-4672-aad5-3b1349a7c52d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:39.497074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55c18b-c6f7-4672-aad5-3b1349a7c52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:39.498705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55c18b-c6f7-4672-aad5-3b1349a7c52d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:39.520783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 61/124] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:39.522381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db198-87df-4dfd-b8af-7eebbc579188 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.522774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db198-87df-4dfd-b8af-7eebbc579188 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.522961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db198-87df-4dfd-b8af-7eebbc579188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.538509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:39.556712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-006db198-87df-4dfd-b8af-7eebbc579188 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:39.560322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-006db198-87df-4dfd-b8af-7eebbc579188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:39.643572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 62/125] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:39.644434 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006db198-87df-4dfd-b8af-7eebbc579188 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:39.691258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224df7b-07d0-4e88-be72-4b2b6140bcb5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:39.712272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:39.765849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006db198-87df-4dfd-b8af-7eebbc579188 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:39.780516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:39.781137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.781415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.781686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.782360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:39.782690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:39.784081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:39.799342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:39.800824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 64/126] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:39.801579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:39.805542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96408217-185f-4083-9df3-b5ee31d858ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:39.806093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96408217-185f-4083-9df3-b5ee31d858ac None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.806374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96408217-185f-4083-9df3-b5ee31d858ac None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.806672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96408217-185f-4083-9df3-b5ee31d858ac None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.807844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96408217-185f-4083-9df3-b5ee31d858ac None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:39.810094 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96408217-185f-4083-9df3-b5ee31d858ac None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:39.811713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 63/127] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:39.812466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96408217-185f-4083-9df3-b5ee31d858ac None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:39.930398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96408217-185f-4083-9df3-b5ee31d858ac None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:39.970793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf148-9a5b-4db3-a7ed-e48d2ea1d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:39.971565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf148-9a5b-4db3-a7ed-e48d2ea1d372 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:39.971851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf148-9a5b-4db3-a7ed-e48d2ea1d372 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:39.972128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf148-9a5b-4db3-a7ed-e48d2ea1d372 None admin] PATH_INFO: `/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:39.973552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baf148-9a5b-4db3-a7ed-e48d2ea1d372 None admin] RBAC: Authorizing `identity:get_user(user_id=5a6ae8d3cbfd4ceca126228b9ed39b13)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:39.976020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baf148-9a5b-4db3-a7ed-e48d2ea1d372 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:39.977719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 64/128] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:39.978505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf148-9a5b-4db3-a7ed-e48d2ea1d372 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:40.032541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108778-0388-407c-a978-b6d510616c9a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:40.061715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:40.102965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf148-9a5b-4db3-a7ed-e48d2ea1d372 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:40.115195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f049ad8-9f34-4f8b-b45d-00387bf54314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:40.115992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049ad8-9f34-4f8b-b45d-00387bf54314 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:40.116378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049ad8-9f34-4f8b-b45d-00387bf54314 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:40.116949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f049ad8-9f34-4f8b-b45d-00387bf54314 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:40.143133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f049ad8-9f34-4f8b-b45d-00387bf54314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:40.143501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650f7e3-8b96-4d7d-898b-f7708c9286ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:40.144338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f7e3-8b96-4d7d-898b-f7708c9286ee None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:40.144790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f7e3-8b96-4d7d-898b-f7708c9286ee None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:40.145261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f7e3-8b96-4d7d-898b-f7708c9286ee None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:40.146609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650f7e3-8b96-4d7d-898b-f7708c9286ee None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:40.148297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650f7e3-8b96-4d7d-898b-f7708c9286ee None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4f049ad8-9f34-4f8b-b45d-00387bf54314 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:40.149181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:40.150040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:40.150860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 65/129] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:40.151482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f049ad8-9f34-4f8b-b45d-00387bf54314 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:40.153780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 65/130] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:39 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:40.159900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650f7e3-8b96-4d7d-898b-f7708c9286ee None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:40.239896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:40.283992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650f7e3-8b96-4d7d-898b-f7708c9286ee None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:40.323207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80b0b2-dfa7-406a-b10f-51ee96cc8a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:40.324663 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b0b2-dfa7-406a-b10f-51ee96cc8a0f None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:40.325150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b0b2-dfa7-406a-b10f-51ee96cc8a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:40.325598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b0b2-dfa7-406a-b10f-51ee96cc8a0f None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb/users/1c8a150ece2241cb8d50235feaf78b41/roles/1cb2ff0f0c514fc19e6847a5c8e3a127` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:40.328219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80b0b2-dfa7-406a-b10f-51ee96cc8a0f None admin] RBAC: Authorizing `identity:create_grant(project_id=33df3de83e2f4538b39277107129f1fb, user_id=1c8a150ece2241cb8d50235feaf78b41, role_id=1cb2ff0f0c514fc19e6847a5c8e3a127)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:40.330273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80b0b2-dfa7-406a-b10f-51ee96cc8a0f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:40.333729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:40.376950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f049ad8-9f34-4f8b-b45d-00387bf54314 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:40.413192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d276eb-a5d8-4edb-9dec-107e62ed079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:40.413981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d276eb-a5d8-4edb-9dec-107e62ed079f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:40.414261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d276eb-a5d8-4edb-9dec-107e62ed079f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:40.414558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d276eb-a5d8-4edb-9dec-107e62ed079f None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:40.415691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d276eb-a5d8-4edb-9dec-107e62ed079f None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:40.417144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d276eb-a5d8-4edb-9dec-107e62ed079f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:40.422882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 66/131] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:40 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:40.422882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d276eb-a5d8-4edb-9dec-107e62ed079f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:40.436159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 66/132] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:40 2022] PUT /identity/v3/projects/33df3de83e2f4538b39277107129f1fb/users/1c8a150ece2241cb8d50235feaf78b41/roles/1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:40.437200 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178181-40fc-46b3-b070-fd71ec0a43a2 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:40.437489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178181-40fc-46b3-b070-fd71ec0a43a2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:40.437764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178181-40fc-46b3-b070-fd71ec0a43a2 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:40.439238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 67/133] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:40.440072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21178181-40fc-46b3-b070-fd71ec0a43a2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:40.560716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21178181-40fc-46b3-b070-fd71ec0a43a2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:40.571682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:40.576940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d276eb-a5d8-4edb-9dec-107e62ed079f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:40.599637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fccb1-ce59-46cf-867c-9e51fa1789c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:40.600413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fccb1-ce59-46cf-867c-9e51fa1789c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:40.600807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fccb1-ce59-46cf-867c-9e51fa1789c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:40.601147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fccb1-ce59-46cf-867c-9e51fa1789c7 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb/users/5a6ae8d3cbfd4ceca126228b9ed39b13/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:40.606848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fccb1-ce59-46cf-867c-9e51fa1789c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=33df3de83e2f4538b39277107129f1fb, user_id=5a6ae8d3cbfd4ceca126228b9ed39b13, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:40.609424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fccb1-ce59-46cf-867c-9e51fa1789c7 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:40.624126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91ef1b-6fa6-4d43-b6ad-11d5a590318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:40.635380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ef1b-6fa6-4d43-b6ad-11d5a590318f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:40.635380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ef1b-6fa6-4d43-b6ad-11d5a590318f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:40.635380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ef1b-6fa6-4d43-b6ad-11d5a590318f None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:40.635380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91ef1b-6fa6-4d43-b6ad-11d5a590318f None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:40.635380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91ef1b-6fa6-4d43-b6ad-11d5a590318f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:40.635380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91ef1b-6fa6-4d43-b6ad-11d5a590318f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:40.639098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 67/134] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:40.640366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fe49b-3125-4265-bfa3-ba2819530535 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:40.640758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fe49b-3125-4265-bfa3-ba2819530535 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:40.641157 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fe49b-3125-4265-bfa3-ba2819530535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:40.662218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9c7fe49b-3125-4265-bfa3-ba2819530535 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:40.663748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9c7fe49b-3125-4265-bfa3-ba2819530535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:40.702731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 68/135] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:40 2022] PUT /identity/v3/projects/33df3de83e2f4538b39277107129f1fb/users/5a6ae8d3cbfd4ceca126228b9ed39b13/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:40.704577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fccb1-ce59-46cf-867c-9e51fa1789c7 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:40.746666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 68/136] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:40.808913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:40.822189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fe49b-3125-4265-bfa3-ba2819530535 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:40.936391 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fccb1-ce59-46cf-867c-9e51fa1789c7 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:40.966929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:40.975915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fe49b-3125-4265-bfa3-ba2819530535 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:41.027841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4e09e-ca7c-4fc6-88b7-2606d4f8e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:41.028504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4e09e-ca7c-4fc6-88b7-2606d4f8e766 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.028791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4e09e-ca7c-4fc6-88b7-2606d4f8e766 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.029068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4e09e-ca7c-4fc6-88b7-2606d4f8e766 None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.032126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4e09e-ca7c-4fc6-88b7-2606d4f8e766 None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:41.033610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4e09e-ca7c-4fc6-88b7-2606d4f8e766 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:41.035291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 69/137] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:40 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:41.039070 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d628a3f-9a29-4834-9552-5c8387555e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:41.039724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628a3f-9a29-4834-9552-5c8387555e97 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.040008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628a3f-9a29-4834-9552-5c8387555e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.040281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628a3f-9a29-4834-9552-5c8387555e97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.040817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4e09e-ca7c-4fc6-88b7-2606d4f8e766 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:41.047379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d628a3f-9a29-4834-9552-5c8387555e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:41.048892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d628a3f-9a29-4834-9552-5c8387555e97 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:41.050639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 69/138] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:41.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d628a3f-9a29-4834-9552-5c8387555e97 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:41.230866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4e09e-ca7c-4fc6-88b7-2606d4f8e766 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:41.245901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d628a3f-9a29-4834-9552-5c8387555e97 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:41.279494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:41.299672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276338af-1bdd-4323-a1ed-df427b25b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:41.300312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276338af-1bdd-4323-a1ed-df427b25b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.300647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276338af-1bdd-4323-a1ed-df427b25b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.300922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276338af-1bdd-4323-a1ed-df427b25b5a0 None admin] PATH_INFO: `/v3/projects/e91a9535b7ec482eab1e44d6653b6aaa` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.302429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276338af-1bdd-4323-a1ed-df427b25b5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e91a9535b7ec482eab1e44d6653b6aaa)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:41.303910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276338af-1bdd-4323-a1ed-df427b25b5a0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:41.305550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 70/139] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:41 2022] GET /identity/v3/projects/e91a9535b7ec482eab1e44d6653b6aaa => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:41.306797 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760df7-64d7-44ff-81d9-38a804305af2 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.307082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760df7-64d7-44ff-81d9-38a804305af2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.307360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760df7-64d7-44ff-81d9-38a804305af2 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.309108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 71/140] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:41.310832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66393081-e915-473e-8d03-a2792204cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:41.311696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393081-e915-473e-8d03-a2792204cada None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.311977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393081-e915-473e-8d03-a2792204cada None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.312249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393081-e915-473e-8d03-a2792204cada None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.312894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66393081-e915-473e-8d03-a2792204cada None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:41.314349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66393081-e915-473e-8d03-a2792204cada None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:41.317684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00760df7-64d7-44ff-81d9-38a804305af2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:41.435770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 70/141] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:22:41 2022] POST /identity/v3/users => generated 283 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:41.437144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa9bc-62d6-48c9-a8f8-02cb57c5e93f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.437433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa9bc-62d6-48c9-a8f8-02cb57c5e93f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.437722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa9bc-62d6-48c9-a8f8-02cb57c5e93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.464001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00760df7-64d7-44ff-81d9-38a804305af2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:41.490489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-da3fa9bc-62d6-48c9-a8f8-02cb57c5e93f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:41.493588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-da3fa9bc-62d6-48c9-a8f8-02cb57c5e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:41.530867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:41.555426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9fb4-3479-418f-a59e-727c4b04f649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:41.557032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9fb4-3479-418f-a59e-727c4b04f649 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.557319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9fb4-3479-418f-a59e-727c4b04f649 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.557595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9fb4-3479-418f-a59e-727c4b04f649 None admin] PATH_INFO: `/v3/projects/e91a9535b7ec482eab1e44d6653b6aaa/users/1c8a150ece2241cb8d50235feaf78b41/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.561152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9fb4-3479-418f-a59e-727c4b04f649 None admin] RBAC: Authorizing `identity:create_grant(project_id=e91a9535b7ec482eab1e44d6653b6aaa, user_id=1c8a150ece2241cb8d50235feaf78b41, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:41.562666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9fb4-3479-418f-a59e-727c4b04f649 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:41.625281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 71/142] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:41.643954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 72/143] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:41 2022] PUT /identity/v3/projects/e91a9535b7ec482eab1e44d6653b6aaa/users/1c8a150ece2241cb8d50235feaf78b41/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:41.655344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa9bc-62d6-48c9-a8f8-02cb57c5e93f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:41.771423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa9bc-62d6-48c9-a8f8-02cb57c5e93f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:41.812789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace80e36-0c57-4086-846b-3152dd47afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:41.813808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80e36-0c57-4086-846b-3152dd47afbb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.814280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80e36-0c57-4086-846b-3152dd47afbb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.814873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80e36-0c57-4086-846b-3152dd47afbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.827056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace80e36-0c57-4086-846b-3152dd47afbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ace80e36-0c57-4086-846b-3152dd47afbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:41.832402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:41.833248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:41.834015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:41.836376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 72/144] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:41.842387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9fb4-3479-418f-a59e-727c4b04f649 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:41.902337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522281-f628-4e28-bddf-8ddeadf5103b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.903535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:41.903819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522281-f628-4e28-bddf-8ddeadf5103b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.904300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522281-f628-4e28-bddf-8ddeadf5103b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.907179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 73/145] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:41.913051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7875575-3f51-46be-bf1d-1046631f6e87 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:41.913441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7875575-3f51-46be-bf1d-1046631f6e87 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:41.919763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7875575-3f51-46be-bf1d-1046631f6e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:41.934207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:41.945047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c7875575-3f51-46be-bf1d-1046631f6e87 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:41.946713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c7875575-3f51-46be-bf1d-1046631f6e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:41.977230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9fb4-3479-418f-a59e-727c4b04f649 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:42.028547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:42.029087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:42.029363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:42.029639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:42.030970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:42.031289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:42.033813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:42.045054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 73/146] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:42.054490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:42.057077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 74/147] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:42.087830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7875575-3f51-46be-bf1d-1046631f6e87 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:42.228201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa4166-9dc8-4f1f-bb3e-1bc0fc5e20e3 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:42.252972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:42.272304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7875575-3f51-46be-bf1d-1046631f6e87 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:42.293495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470f5c8-0e64-4b55-8030-c8e9cde76118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:42.294062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f5c8-0e64-4b55-8030-c8e9cde76118 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:42.294339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f5c8-0e64-4b55-8030-c8e9cde76118 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:42.294637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f5c8-0e64-4b55-8030-c8e9cde76118 None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:42.296559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470f5c8-0e64-4b55-8030-c8e9cde76118 None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:42.298013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470f5c8-0e64-4b55-8030-c8e9cde76118 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:42.299646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 74/148] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:42 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:42.305207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470f5c8-0e64-4b55-8030-c8e9cde76118 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:42.340406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c823417-926f-4eb6-b3bf-9727e9fd9355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:42.341050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c823417-926f-4eb6-b3bf-9727e9fd9355 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:42.341325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c823417-926f-4eb6-b3bf-9727e9fd9355 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:42.341589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c823417-926f-4eb6-b3bf-9727e9fd9355 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:42.346001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:42.357122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c823417-926f-4eb6-b3bf-9727e9fd9355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6c823417-926f-4eb6-b3bf-9727e9fd9355 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:42.361860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:42.366239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:42.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 75/149] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:42.383089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c823417-926f-4eb6-b3bf-9727e9fd9355 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:42.511821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470f5c8-0e64-4b55-8030-c8e9cde76118 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:42.567379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c823417-926f-4eb6-b3bf-9727e9fd9355 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:42.579293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0011ca-fc79-460d-8843-a31f91fdee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:42.579905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0011ca-fc79-460d-8843-a31f91fdee3d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:42.580181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0011ca-fc79-460d-8843-a31f91fdee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:42.580448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0011ca-fc79-460d-8843-a31f91fdee3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:42.638133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:42.639801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:42.640079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:42.640351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:42.641027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:42.641327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:42.643657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:42.655242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 76/150] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:42.661620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:42.679241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:42.718884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0011ca-fc79-460d-8843-a31f91fdee3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:42.720831 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0011ca-fc79-460d-8843-a31f91fdee3d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:42.772270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:42.855597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7a89-6127-43be-b7dd-0a50b754d313 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:42.904808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 75/151] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:42.910591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0011ca-fc79-460d-8843-a31f91fdee3d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:42.920881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ad8bb-af90-4755-a80e-531e2031c912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:42.921532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad8bb-af90-4755-a80e-531e2031c912 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:42.921810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad8bb-af90-4755-a80e-531e2031c912 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:42.922086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad8bb-af90-4755-a80e-531e2031c912 None admin] PATH_INFO: `/v3/users/870f7d9de55b4484934c0054adc3aa51` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:42.923545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ad8bb-af90-4755-a80e-531e2031c912 None admin] RBAC: Authorizing `identity:get_user(user_id=870f7d9de55b4484934c0054adc3aa51)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:42.925019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ad8bb-af90-4755-a80e-531e2031c912 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:42.926970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 77/152] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:42 2022] GET /identity/v3/users/870f7d9de55b4484934c0054adc3aa51 => generated 289 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:42.935673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ad8bb-af90-4755-a80e-531e2031c912 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:43.074595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:43.102155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ad8bb-af90-4755-a80e-531e2031c912 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:43.107487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0011ca-fc79-460d-8843-a31f91fdee3d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:43.150592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:43.166557 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e815344-ef40-46e9-a0ee-89faf8038e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:43.167754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e815344-ef40-46e9-a0ee-89faf8038e5e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:43.168041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e815344-ef40-46e9-a0ee-89faf8038e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:43.168317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e815344-ef40-46e9-a0ee-89faf8038e5e None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:43.168761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926a24e-845e-4c32-a7c6-8063589a5f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:43.169596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e815344-ef40-46e9-a0ee-89faf8038e5e None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:43.169785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a24e-845e-4c32-a7c6-8063589a5f74 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:43.170189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a24e-845e-4c32-a7c6-8063589a5f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:43.170622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a24e-845e-4c32-a7c6-8063589a5f74 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:43.173312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e815344-ef40-46e9-a0ee-89faf8038e5e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:43.173312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 78/153] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:42 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:43.174260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926a24e-845e-4c32-a7c6-8063589a5f74 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:43.177200 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926a24e-845e-4c32-a7c6-8063589a5f74 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:43.179340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e815344-ef40-46e9-a0ee-89faf8038e5e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:43.179534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 76/154] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:42 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:43.185052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926a24e-845e-4c32-a7c6-8063589a5f74 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:43.305620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e815344-ef40-46e9-a0ee-89faf8038e5e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:43.349075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8066af9-739f-41b1-a75d-4ef8d885b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:43.350399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8066af9-739f-41b1-a75d-4ef8d885b248 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:43.350834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8066af9-739f-41b1-a75d-4ef8d885b248 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:43.351232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8066af9-739f-41b1-a75d-4ef8d885b248 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb/users/870f7d9de55b4484934c0054adc3aa51/roles/09d6cbb5feda48f389570c916edfda07` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:43.353606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8066af9-739f-41b1-a75d-4ef8d885b248 None admin] RBAC: Authorizing `identity:create_grant(project_id=33df3de83e2f4538b39277107129f1fb, user_id=870f7d9de55b4484934c0054adc3aa51, role_id=09d6cbb5feda48f389570c916edfda07)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:43.355481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8066af9-739f-41b1-a75d-4ef8d885b248 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:43.406507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926a24e-845e-4c32-a7c6-8063589a5f74 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:43.441929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 79/155] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:43 2022] PUT /identity/v3/projects/33df3de83e2f4538b39277107129f1fb/users/870f7d9de55b4484934c0054adc3aa51/roles/09d6cbb5feda48f389570c916edfda07 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:43.444918 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2a9e7-c202-4f16-b0c0-da542144e8ea None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:43.446164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2a9e7-c202-4f16-b0c0-da542144e8ea None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:43.447694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2a9e7-c202-4f16-b0c0-da542144e8ea None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:43.449987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 80/156] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:43.458582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:43.459470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:43.459941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:43.461472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e64a-c6d7-4067-a8e5-d6f1e6aaa7e5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:43.461940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e64a-c6d7-4067-a8e5-d6f1e6aaa7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:43.462436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e64a-c6d7-4067-a8e5-d6f1e6aaa7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:43.466315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:43.467417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] RBAC: Adding query filter params (role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=33df3de83e2f4538b39277107129f1fb, user.id=1c8a150ece2241cb8d50235feaf78b41) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:43.467915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:43.469641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:43.481699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 77/157] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:43 2022] GET /identity/v3/role_assignments?user.id=1c8a150ece2241cb8d50235feaf78b41&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=4851e677104948daa4c8bcf195bd8608 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:43.499200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-46d9e64a-c6d7-4067-a8e5-d6f1e6aaa7e5 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:43.500644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-46d9e64a-c6d7-4067-a8e5-d6f1e6aaa7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:43.588410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:43.608479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 81/158] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:43.659987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:43.684042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:43.782836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac4413-b9b2-4418-a6a1-3c3ba8a211f9 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:43.826415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc28ae-3cec-48c8-8067-974dc1e69f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:43.827307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc28ae-3cec-48c8-8067-974dc1e69f9e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:43.827849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc28ae-3cec-48c8-8067-974dc1e69f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:43.828267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc28ae-3cec-48c8-8067-974dc1e69f9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:43.844764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc28ae-3cec-48c8-8067-974dc1e69f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f4bc28ae-3cec-48c8-8067-974dc1e69f9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:43.850134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:43.851225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:43.852174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:43.854168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 78/159] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:22:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:43.860819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e64a-c6d7-4067-a8e5-d6f1e6aaa7e5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:43.995853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e64a-c6d7-4067-a8e5-d6f1e6aaa7e5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:44.034134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc037-749f-4489-b7ed-fda5cead7078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:44.034843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc037-749f-4489-b7ed-fda5cead7078 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:44.035127 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc037-749f-4489-b7ed-fda5cead7078 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:44.035468 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc037-749f-4489-b7ed-fda5cead7078 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:44.036201 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc037-749f-4489-b7ed-fda5cead7078 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:44.036506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc037-749f-4489-b7ed-fda5cead7078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:44.037990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc037-749f-4489-b7ed-fda5cead7078 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:44.043050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d9061-026f-461c-ac9f-c45c1a1db5bc None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:44.044063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d9061-026f-461c-ac9f-c45c1a1db5bc None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:44.044546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d9061-026f-461c-ac9f-c45c1a1db5bc None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:44.046089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 79/160] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:44.048459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 82/161] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:22:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:44.051749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf924a-cff3-46b2-bbfe-ed907c062682 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:44.052106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf924a-cff3-46b2-bbfe-ed907c062682 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:44.052383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf924a-cff3-46b2-bbfe-ed907c062682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:44.053293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d9061-026f-461c-ac9f-c45c1a1db5bc None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:44.083497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d7cf924a-cff3-46b2-bbfe-ed907c062682 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:44.084840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d7cf924a-cff3-46b2-bbfe-ed907c062682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:44.137835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:44.168772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 83/162] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:44.261758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf924a-cff3-46b2-bbfe-ed907c062682 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:44.261969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:44.261969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d9061-026f-461c-ac9f-c45c1a1db5bc None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:44.301140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091302ba-e652-45fc-ac80-9d36786af215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:44.301848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091302ba-e652-45fc-ac80-9d36786af215 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:44.302130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091302ba-e652-45fc-ac80-9d36786af215 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:44.302416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091302ba-e652-45fc-ac80-9d36786af215 None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:44.304210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091302ba-e652-45fc-ac80-9d36786af215 None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:44.305898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091302ba-e652-45fc-ac80-9d36786af215 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:44.308250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 80/163] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:44 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:44.314511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091302ba-e652-45fc-ac80-9d36786af215 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:44.431744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf924a-cff3-46b2-bbfe-ed907c062682 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:44.438490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091302ba-e652-45fc-ac80-9d36786af215 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:44.477321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899160-b066-4b9e-89f4-e4de04146453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:44.478142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899160-b066-4b9e-89f4-e4de04146453 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:44.478426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899160-b066-4b9e-89f4-e4de04146453 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:44.478724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899160-b066-4b9e-89f4-e4de04146453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:44.499909 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:44.513250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddec8f-5c9a-4f59-97cc-b3ee8722ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:44.514226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddec8f-5c9a-4f59-97cc-b3ee8722ac4f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:44.514728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddec8f-5c9a-4f59-97cc-b3ee8722ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:44.515203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddec8f-5c9a-4f59-97cc-b3ee8722ac4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:44.542614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddec8f-5c9a-4f59-97cc-b3ee8722ac4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a7ddec8f-5c9a-4f59-97cc-b3ee8722ac4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:44.556067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:44.557008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:44.558348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:44.559765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2899160-b066-4b9e-89f4-e4de04146453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:44.561010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2899160-b066-4b9e-89f4-e4de04146453 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:44.561772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 84/164] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:44.584304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddec8f-5c9a-4f59-97cc-b3ee8722ac4f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:44.681424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 81/165] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:22:44.685377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:44.689252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899160-b066-4b9e-89f4-e4de04146453 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:44.742516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:44.812889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899160-b066-4b9e-89f4-e4de04146453 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:44.824952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddec8f-5c9a-4f59-97cc-b3ee8722ac4f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:44.855402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f332d-fbaa-4d16-91c6-810f9a5c3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:44.856509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f332d-fbaa-4d16-91c6-810f9a5c3a24 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:44.857007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f332d-fbaa-4d16-91c6-810f9a5c3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:44.857441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f332d-fbaa-4d16-91c6-810f9a5c3a24 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:44.858759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f332d-fbaa-4d16-91c6-810f9a5c3a24 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:44.860791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f332d-fbaa-4d16-91c6-810f9a5c3a24 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:44.862973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 82/166] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:44 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:44.869615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f332d-fbaa-4d16-91c6-810f9a5c3a24 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:44.919873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:44.920508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:44.920779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:44.921054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:44.924011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:44.924011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:44.924011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:44.952422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 85/167] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:44.959454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:44.995476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f332d-fbaa-4d16-91c6-810f9a5c3a24 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:45.018825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:45.096303 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:45.096931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:45.097192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:45.097372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:45.098104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] RBAC: Adding query filter params (role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=33df3de83e2f4538b39277107129f1fb, user.id=1c8a150ece2241cb8d50235feaf78b41) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:45.098413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:45.099877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:45.117265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 83/168] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:44 2022] GET /identity/v3/role_assignments?user.id=1c8a150ece2241cb8d50235feaf78b41&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:45.184910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:45.190094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e435c3-1c38-41f8-907f-7ec521680905 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:45.238616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26f380-eb2b-4951-b200-009161ddf42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:45.239271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f380-eb2b-4951-b200-009161ddf42a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:45.239549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f380-eb2b-4951-b200-009161ddf42a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:45.239949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f380-eb2b-4951-b200-009161ddf42a None admin] PATH_INFO: `/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:45.247755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26f380-eb2b-4951-b200-009161ddf42a None admin] RBAC: Authorizing `identity:get_user(user_id=5a6ae8d3cbfd4ceca126228b9ed39b13)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:45.249350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26f380-eb2b-4951-b200-009161ddf42a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:45.251563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 86/169] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:44 2022] GET /identity/v3/users/5a6ae8d3cbfd4ceca126228b9ed39b13 => generated 247 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:45.257410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:45.444122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bd4a0-a0cc-41da-9ee9-514c5d91fc58 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:45.498804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d0af-ff2b-4593-8fe6-c19aa1cbe3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:45.499408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d0af-ff2b-4593-8fe6-c19aa1cbe3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:45.499681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d0af-ff2b-4593-8fe6-c19aa1cbe3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:45.499948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d0af-ff2b-4593-8fe6-c19aa1cbe3a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:45.554042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:45.584847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68d0af-ff2b-4593-8fe6-c19aa1cbe3a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:45.586307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68d0af-ff2b-4593-8fe6-c19aa1cbe3a0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:45.604915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0c7e-2c3a-4f78-80f4-cc084e40941b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:45.605200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0c7e-2c3a-4f78-80f4-cc084e40941b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:45.605476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0c7e-2c3a-4f78-80f4-cc084e40941b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:45.606862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 87/170] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:45.615768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481620f-c412-4b45-9ead-c2597c25f5bc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:45.616047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481620f-c412-4b45-9ead-c2597c25f5bc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:45.616314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481620f-c412-4b45-9ead-c2597c25f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:45.663494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2481620f-c412-4b45-9ead-c2597c25f5bc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:45.664711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2481620f-c412-4b45-9ead-c2597c25f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:45.770058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 84/171] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:45.775724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d0af-ff2b-4593-8fe6-c19aa1cbe3a0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:45.784997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 88/172] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:45.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481620f-c412-4b45-9ead-c2597c25f5bc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:45.899890 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:45.960421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d0af-ff2b-4593-8fe6-c19aa1cbe3a0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.027981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:46.043328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481620f-c412-4b45-9ead-c2597c25f5bc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.047310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef937cc4-fd78-4c35-bd89-2c311712f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.047965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937cc4-fd78-4c35-bd89-2c311712f326 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.048244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937cc4-fd78-4c35-bd89-2c311712f326 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.048512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef937cc4-fd78-4c35-bd89-2c311712f326 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.049654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef937cc4-fd78-4c35-bd89-2c311712f326 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:46.055796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef937cc4-fd78-4c35-bd89-2c311712f326 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:46.058652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 85/173] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:45 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:46.065243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef937cc4-fd78-4c35-bd89-2c311712f326 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:46.113578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de2b8f-abb7-41e9-a02b-0eb1c8c6933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.114222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2b8f-abb7-41e9-a02b-0eb1c8c6933a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.114530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2b8f-abb7-41e9-a02b-0eb1c8c6933a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.114796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2b8f-abb7-41e9-a02b-0eb1c8c6933a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.147118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de2b8f-abb7-41e9-a02b-0eb1c8c6933a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-69de2b8f-abb7-41e9-a02b-0eb1c8c6933a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:46.152539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:46.153422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:46.154213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 89/174] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:46.160988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de2b8f-abb7-41e9-a02b-0eb1c8c6933a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:46.268404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef937cc4-fd78-4c35-bd89-2c311712f326 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.318957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa2dd5-1b83-4b31-ba81-c65c00f47c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.319735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa2dd5-1b83-4b31-ba81-c65c00f47c93 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.320425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa2dd5-1b83-4b31-ba81-c65c00f47c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.320702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa2dd5-1b83-4b31-ba81-c65c00f47c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.321972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa2dd5-1b83-4b31-ba81-c65c00f47c93 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=33df3de83e2f4538b39277107129f1fb, user.id=5a6ae8d3cbfd4ceca126228b9ed39b13) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:46.322284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa2dd5-1b83-4b31-ba81-c65c00f47c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:46.325187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa2dd5-1b83-4b31-ba81-c65c00f47c93 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:46.326933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de2b8f-abb7-41e9-a02b-0eb1c8c6933a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.332233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 86/175] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:46 2022] GET /identity/v3/role_assignments?user.id=5a6ae8d3cbfd4ceca126228b9ed39b13&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=45149274288845b0a73e18fbb3394202 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:46.333479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93338f-4150-4626-9a4a-248c01d62a69 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.333766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93338f-4150-4626-9a4a-248c01d62a69 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.334038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93338f-4150-4626-9a4a-248c01d62a69 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.335990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 87/176] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:46.336893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350b7bc-11e1-4da2-b6c9-9b9a2ec1a245 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.338814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350b7bc-11e1-4da2-b6c9-9b9a2ec1a245 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.339672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350b7bc-11e1-4da2-b6c9-9b9a2ec1a245 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.342576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 88/177] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:46.343913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61dc8-bc9e-4b33-bb33-6317b1686dcd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.344197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61dc8-bc9e-4b33-bb33-6317b1686dcd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.344471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa61dc8-bc9e-4b33-bb33-6317b1686dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.360539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:46.367591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-faa61dc8-bc9e-4b33-bb33-6317b1686dcd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:46.369187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-faa61dc8-bc9e-4b33-bb33-6317b1686dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:46.380695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20437a-c7f7-4878-afcb-dcf5e5d3b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.381634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20437a-c7f7-4878-afcb-dcf5e5d3b0ba None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.381917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20437a-c7f7-4878-afcb-dcf5e5d3b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.382193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20437a-c7f7-4878-afcb-dcf5e5d3b0ba None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.383201 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20437a-c7f7-4878-afcb-dcf5e5d3b0ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:46.383513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20437a-c7f7-4878-afcb-dcf5e5d3b0ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:46.385163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20437a-c7f7-4878-afcb-dcf5e5d3b0ba None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:46.398299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 90/178] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:46.404717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0747b-a13a-4842-8579-9d71ed316669 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.405020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0747b-a13a-4842-8579-9d71ed316669 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.405295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0747b-a13a-4842-8579-9d71ed316669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.425546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-86c0747b-a13a-4842-8579-9d71ed316669 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:46.426834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-86c0747b-a13a-4842-8579-9d71ed316669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:46.442646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:46.473528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 89/179] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:46.476101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa61dc8-bc9e-4b33-bb33-6317b1686dcd None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:46.536262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 91/180] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:46.538697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f23a-3c24-44b7-a864-aafab29cea08 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.538981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f23a-3c24-44b7-a864-aafab29cea08 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.539252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f23a-3c24-44b7-a864-aafab29cea08 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.540731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 92/181] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:46.545339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4f23a-3c24-44b7-a864-aafab29cea08 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:46.633376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa61dc8-bc9e-4b33-bb33-6317b1686dcd None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.665040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4f23a-3c24-44b7-a864-aafab29cea08 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.673689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae57c-ebe6-4353-b74a-f4fda8cb9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.674329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae57c-ebe6-4353-b74a-f4fda8cb9c1f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.674658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae57c-ebe6-4353-b74a-f4fda8cb9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.674934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae57c-ebe6-4353-b74a-f4fda8cb9c1f None admin] PATH_INFO: `/v3/users/1c8a150ece2241cb8d50235feaf78b41` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.676111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ae57c-ebe6-4353-b74a-f4fda8cb9c1f None admin] RBAC: Authorizing `identity:get_user(user_id=1c8a150ece2241cb8d50235feaf78b41)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:46.677558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ae57c-ebe6-4353-b74a-f4fda8cb9c1f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:46.679400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 90/182] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:46 2022] GET /identity/v3/users/1c8a150ece2241cb8d50235feaf78b41 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:46.680513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9df1-4d31-42fa-8509-36f8039e655f None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.680824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9df1-4d31-42fa-8509-36f8039e655f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.681062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9df1-4d31-42fa-8509-36f8039e655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.690347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:46.702818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bf2d9df1-4d31-42fa-8509-36f8039e655f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:46.713760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bf2d9df1-4d31-42fa-8509-36f8039e655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:46.714407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f50f2c-4a6e-4c8f-a6d3-755176968dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.714407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50f2c-4a6e-4c8f-a6d3-755176968dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.714407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50f2c-4a6e-4c8f-a6d3-755176968dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.714407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50f2c-4a6e-4c8f-a6d3-755176968dc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.719419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f50f2c-4a6e-4c8f-a6d3-755176968dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-28f50f2c-4a6e-4c8f-a6d3-755176968dc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:46.724275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:46.725176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:46.725981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 93/183] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:46.726659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f50f2c-4a6e-4c8f-a6d3-755176968dc1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:46.738041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:46.782505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 91/184] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:46.786802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d9df1-4d31-42fa-8509-36f8039e655f None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:46.842453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f50f2c-4a6e-4c8f-a6d3-755176968dc1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.878853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61ee1-6511-4e25-9225-6dc5f35369a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.879745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61ee1-6511-4e25-9225-6dc5f35369a6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.880172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61ee1-6511-4e25-9225-6dc5f35369a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.880590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61ee1-6511-4e25-9225-6dc5f35369a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.890110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d9df1-4d31-42fa-8509-36f8039e655f None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:46.891722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db61ee1-6511-4e25-9225-6dc5f35369a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8db61ee1-6511-4e25-9225-6dc5f35369a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:46.896892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:46.897873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:46.898896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:46.900825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 94/185] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:46.902253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61ee1-6511-4e25-9225-6dc5f35369a6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:46.933078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f5403-ea03-4f72-9473-188d054492c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:46.933689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5403-ea03-4f72-9473-188d054492c1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:46.933979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5403-ea03-4f72-9473-188d054492c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:46.934231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5403-ea03-4f72-9473-188d054492c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:46.937194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:46.992087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:47.007915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f5403-ea03-4f72-9473-188d054492c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.009386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f5403-ea03-4f72-9473-188d054492c1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.028416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61ee1-6511-4e25-9225-6dc5f35369a6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.063945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.064559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.064840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.065112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.065791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:47.066097 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.067519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.076245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 95/186] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:47.077039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.115858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 92/187] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:47.116698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f5403-ea03-4f72-9473-188d054492c1 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.149040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:47.180194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2deb-c6e4-4244-a6c6-e43c81361f92 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.208438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:47.214068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c0f91-4b59-4197-923f-fd3292c1d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.214724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0f91-4b59-4197-923f-fd3292c1d853 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.214999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0f91-4b59-4197-923f-fd3292c1d853 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.215265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0f91-4b59-4197-923f-fd3292c1d853 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.215681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f5403-ea03-4f72-9473-188d054492c1 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.216374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c0f91-4b59-4197-923f-fd3292c1d853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.217818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c0f91-4b59-4197-923f-fd3292c1d853 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.219414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 96/188] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:47.224517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c0f91-4b59-4197-923f-fd3292c1d853 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.251638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92e816-4dd6-4430-b907-b2a3df64812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.252238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e816-4dd6-4430-b907-b2a3df64812b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.252515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e816-4dd6-4430-b907-b2a3df64812b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.252783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e816-4dd6-4430-b907-b2a3df64812b None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.253455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92e816-4dd6-4430-b907-b2a3df64812b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:47.253754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92e816-4dd6-4430-b907-b2a3df64812b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.255152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92e816-4dd6-4430-b907-b2a3df64812b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.263064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 93/189] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:22:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:47.263064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f2d96-eead-43fa-bba4-274b316ae60a None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.263064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f2d96-eead-43fa-bba4-274b316ae60a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.263064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f2d96-eead-43fa-bba4-274b316ae60a None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.263064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 94/190] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:47.263064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f2d96-eead-43fa-bba4-274b316ae60a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.327868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c0f91-4b59-4197-923f-fd3292c1d853 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.359919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:47.361959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7abcb-4c82-4c2f-85c5-234c1ee098a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.362623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7abcb-4c82-4c2f-85c5-234c1ee098a4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.362899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7abcb-4c82-4c2f-85c5-234c1ee098a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.363167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7abcb-4c82-4c2f-85c5-234c1ee098a4 None admin] PATH_INFO: `/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.366341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f2d96-eead-43fa-bba4-274b316ae60a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.376198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7abcb-4c82-4c2f-85c5-234c1ee098a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cd37a1dcf3eb4f38bcc22142a655aab3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.377649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7abcb-4c82-4c2f-85c5-234c1ee098a4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.379446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 97/191] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:47 2022] GET /identity/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:47.380013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7abcb-4c82-4c2f-85c5-234c1ee098a4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.399168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084345b2-5b2e-4c91-9762-3ffa6238ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.399727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084345b2-5b2e-4c91-9762-3ffa6238ff5b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.400008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084345b2-5b2e-4c91-9762-3ffa6238ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.400281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084345b2-5b2e-4c91-9762-3ffa6238ff5b None admin] PATH_INFO: `/v3/projects/e91a9535b7ec482eab1e44d6653b6aaa` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.401895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084345b2-5b2e-4c91-9762-3ffa6238ff5b None admin] RBAC: Authorizing `identity:get_project(project_id=e91a9535b7ec482eab1e44d6653b6aaa)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.403838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084345b2-5b2e-4c91-9762-3ffa6238ff5b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.405807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 95/192] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:47 2022] GET /identity/v3/projects/e91a9535b7ec482eab1e44d6653b6aaa => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:47.411166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084345b2-5b2e-4c91-9762-3ffa6238ff5b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.436723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:47.480357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7abcb-4c82-4c2f-85c5-234c1ee098a4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.508503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084345b2-5b2e-4c91-9762-3ffa6238ff5b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.512878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c4d55-e3fc-42fd-b221-a4df3187cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.513487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4d55-e3fc-42fd-b221-a4df3187cbf0 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.513769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4d55-e3fc-42fd-b221-a4df3187cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.514040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4d55-e3fc-42fd-b221-a4df3187cbf0 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.514707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c4d55-e3fc-42fd-b221-a4df3187cbf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.516148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c4d55-e3fc-42fd-b221-a4df3187cbf0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.541597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de74b3f-d3c4-40c3-ad90-b7fc2633e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.542833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de74b3f-d3c4-40c3-ad90-b7fc2633e615 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.543112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de74b3f-d3c4-40c3-ad90-b7fc2633e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.543382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de74b3f-d3c4-40c3-ad90-b7fc2633e615 None admin] PATH_INFO: `/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de74b3f-d3c4-40c3-ad90-b7fc2633e615 None admin] RBAC: Authorizing `identity:get_user(user_id=cd37a1dcf3eb4f38bcc22142a655aab3)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.545935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de74b3f-d3c4-40c3-ad90-b7fc2633e615 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.547568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 96/193] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:47 2022] GET /identity/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:47.548702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a385778-5262-45fa-b62c-a3832749afb2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.548983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a385778-5262-45fa-b62c-a3832749afb2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.549254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a385778-5262-45fa-b62c-a3832749afb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.565898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1a385778-5262-45fa-b62c-a3832749afb2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:47.567117 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1a385778-5262-45fa-b62c-a3832749afb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:47.593927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:47.617681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 98/194] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:22:47 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:47.629351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c4d55-e3fc-42fd-b221-a4df3187cbf0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.635165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 97/195] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:47.635863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a385778-5262-45fa-b62c-a3832749afb2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.743551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c4d55-e3fc-42fd-b221-a4df3187cbf0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.747095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a385778-5262-45fa-b62c-a3832749afb2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:47.757829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:47.781985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9063-6715-435a-bd85-2576cb051bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.782719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9063-6715-435a-bd85-2576cb051bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.782980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9063-6715-435a-bd85-2576cb051bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.783249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9063-6715-435a-bd85-2576cb051bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.785747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:47.786356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:47.786720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:47.786997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:47.787737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] RBAC: Adding query filter params (role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=e91a9535b7ec482eab1e44d6653b6aaa, user.id=1c8a150ece2241cb8d50235feaf78b41) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:47.788048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.789478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.802490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 98/196] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:47 2022] GET /identity/v3/role_assignments?user.id=1c8a150ece2241cb8d50235feaf78b41&scope.project.id=e91a9535b7ec482eab1e44d6653b6aaa&role.id=4851e677104948daa4c8bcf195bd8608 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:47.802490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:47.840346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:47.895271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac9063-6715-435a-bd85-2576cb051bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:47.896812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac9063-6715-435a-bd85-2576cb051bf3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:47.965018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9d80a-0c1a-4967-a49f-85b367ff386b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:48.009493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91def47e-db69-4fe6-ab0b-3a31bd62744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:48.010034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91def47e-db69-4fe6-ab0b-3a31bd62744d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:48.010308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91def47e-db69-4fe6-ab0b-3a31bd62744d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:48.010613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91def47e-db69-4fe6-ab0b-3a31bd62744d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:48.032902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 99/197] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:48.033587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9063-6715-435a-bd85-2576cb051bf3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:48.049059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:48.115749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91def47e-db69-4fe6-ab0b-3a31bd62744d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:48.117622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91def47e-db69-4fe6-ab0b-3a31bd62744d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:48.154224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9063-6715-435a-bd85-2576cb051bf3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:48.155090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:48.198862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883d93-6b9d-495c-9166-bbbd6bb3dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:48.199973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883d93-6b9d-495c-9166-bbbd6bb3dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:48.200265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883d93-6b9d-495c-9166-bbbd6bb3dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:48.200531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883d93-6b9d-495c-9166-bbbd6bb3dfa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:48.214711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de883d93-6b9d-495c-9166-bbbd6bb3dfa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-de883d93-6b9d-495c-9166-bbbd6bb3dfa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:48.221252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:48.222145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:48.222980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 100/198] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:48.224294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883d93-6b9d-495c-9166-bbbd6bb3dfa5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:48.248651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 99/199] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:48.250019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91def47e-db69-4fe6-ab0b-3a31bd62744d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:48.327487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:48.367542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883d93-6b9d-495c-9166-bbbd6bb3dfa5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:48.371325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91def47e-db69-4fe6-ab0b-3a31bd62744d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:48.406781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7fa4b-fc81-45f3-9368-b65a99230158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:48.407419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7fa4b-fc81-45f3-9368-b65a99230158 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:48.407701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7fa4b-fc81-45f3-9368-b65a99230158 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:48.407973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7fa4b-fc81-45f3-9368-b65a99230158 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:48.409112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7fa4b-fc81-45f3-9368-b65a99230158 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:48.409466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:48.411017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7fa4b-fc81-45f3-9368-b65a99230158 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:48.412697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 101/200] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:48 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:48.418889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7fa4b-fc81-45f3-9368-b65a99230158 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:48.423228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:48.423228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:48.423228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:48.423228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:48.423555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:48.423555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:48.424713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:48.435058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 100/201] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:48.436217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:48.549155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7fa4b-fc81-45f3-9368-b65a99230158 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:48.555738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222a4be-e579-4249-b146-a5558871acc8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:48.592349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:48.592734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444833b-e4d1-4515-8aab-9c2c84e444b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:48.593373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444833b-e4d1-4515-8aab-9c2c84e444b2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:48.593650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444833b-e4d1-4515-8aab-9c2c84e444b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:48.593916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444833b-e4d1-4515-8aab-9c2c84e444b2 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:48.594174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:48.594681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:48.595068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444833b-e4d1-4515-8aab-9c2c84e444b2 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:48.595362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:48.596305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=ee1d1fb582804a18bbe932f7917df50c, user.id=cd37a1dcf3eb4f38bcc22142a655aab3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:48.596508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444833b-e4d1-4515-8aab-9c2c84e444b2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:48.597008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:48.598262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 102/202] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:48 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:48.599064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:48.603197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444833b-e4d1-4515-8aab-9c2c84e444b2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:48.609519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 101/203] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:48 2022] GET /identity/v3/role_assignments?user.id=cd37a1dcf3eb4f38bcc22142a655aab3&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=45149274288845b0a73e18fbb3394202 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:48.616075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:48.620920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:48.722900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:48.802099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690520d3-417b-414e-9b08-cc09533c37b1 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:48.804532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444833b-e4d1-4515-8aab-9c2c84e444b2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:48.841809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:48.842506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:48.842714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:48.842984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:48.843713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] RBAC: Adding query filter params (role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=ee1d1fb582804a18bbe932f7917df50c, user.id=cd37a1dcf3eb4f38bcc22142a655aab3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:48.843925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ecd71-a956-4960-99d0-6a197c46e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:48.844046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:48.844847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecd71-a956-4960-99d0-6a197c46e9af None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:48.845324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecd71-a956-4960-99d0-6a197c46e9af None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:48.845433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:48.845878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecd71-a956-4960-99d0-6a197c46e9af None admin] PATH_INFO: `/v3/users/870f7d9de55b4484934c0054adc3aa51` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:48.847406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ecd71-a956-4960-99d0-6a197c46e9af None admin] RBAC: Authorizing `identity:get_user(user_id=870f7d9de55b4484934c0054adc3aa51)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:48.849190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ecd71-a956-4960-99d0-6a197c46e9af None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:48.851104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 103/204] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:48 2022] GET /identity/v3/users/870f7d9de55b4484934c0054adc3aa51 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:48.851374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 102/205] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:48 2022] GET /identity/v3/role_assignments?user.id=cd37a1dcf3eb4f38bcc22142a655aab3&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:48.857776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ecd71-a956-4960-99d0-6a197c46e9af None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:48.950855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:48.972825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ecd71-a956-4960-99d0-6a197c46e9af None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:49.012270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e04db-dd9c-4f11-bc76-9394fa6117a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:49.012880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e04db-dd9c-4f11-bc76-9394fa6117a2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:49.013151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e04db-dd9c-4f11-bc76-9394fa6117a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:49.013415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e04db-dd9c-4f11-bc76-9394fa6117a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:49.086096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e04db-dd9c-4f11-bc76-9394fa6117a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:49.087635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e04db-dd9c-4f11-bc76-9394fa6117a2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:49.168279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:49.191936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 104/206] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:49.197884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:49.386620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e8e32-c09f-4d74-9170-cebcb47b477c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:49.408322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:49.431080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ec951-899d-4744-9c6a-b139849f9fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:49.432036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ec951-899d-4744-9c6a-b139849f9fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:49.432536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ec951-899d-4744-9c6a-b139849f9fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:49.433000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ec951-899d-4744-9c6a-b139849f9fe6 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:49.434332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ec951-899d-4744-9c6a-b139849f9fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:49.435994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ec951-899d-4744-9c6a-b139849f9fe6 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:49.437813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 103/207] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:49 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:49.443926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e04db-dd9c-4f11-bc76-9394fa6117a2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:49.613810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e04db-dd9c-4f11-bc76-9394fa6117a2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:49.662459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997bdf9-64c9-48bc-87ff-e480ad9ddd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:49.663100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bdf9-64c9-48bc-87ff-e480ad9ddd31 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:49.663375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bdf9-64c9-48bc-87ff-e480ad9ddd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:49.663647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997bdf9-64c9-48bc-87ff-e480ad9ddd31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:49.664385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997bdf9-64c9-48bc-87ff-e480ad9ddd31 None admin] RBAC: Adding query filter params (role.id=09d6cbb5feda48f389570c916edfda07, scope.project.id=33df3de83e2f4538b39277107129f1fb, user.id=870f7d9de55b4484934c0054adc3aa51) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:49.664695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997bdf9-64c9-48bc-87ff-e480ad9ddd31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:49.666142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997bdf9-64c9-48bc-87ff-e480ad9ddd31 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:49.674361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 105/208] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:49 2022] GET /identity/v3/role_assignments?user.id=870f7d9de55b4484934c0054adc3aa51&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=09d6cbb5feda48f389570c916edfda07 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:50.051970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007db14d-3953-4b54-aff0-ff1146e7fae1 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.052346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007db14d-3953-4b54-aff0-ff1146e7fae1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.052518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007db14d-3953-4b54-aff0-ff1146e7fae1 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.053982 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 104/209] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:50.059988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7239e-645c-41d8-93cd-0ebd4823efa2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.060268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7239e-645c-41d8-93cd-0ebd4823efa2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.060544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7239e-645c-41d8-93cd-0ebd4823efa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.081627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-efd7239e-645c-41d8-93cd-0ebd4823efa2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:50.082851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-efd7239e-645c-41d8-93cd-0ebd4823efa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:50.092045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822397a-8911-4780-9308-a114749736f7 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.092607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822397a-8911-4780-9308-a114749736f7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.093055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822397a-8911-4780-9308-a114749736f7 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.094697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 105/210] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:50.099606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f55d-a4e2-47dc-a4b8-f982ab030a38 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.100098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f55d-a4e2-47dc-a4b8-f982ab030a38 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.100559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f55d-a4e2-47dc-a4b8-f982ab030a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.120597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:50.127675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a5a7f55d-a4e2-47dc-a4b8-f982ab030a38 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:50.128312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a5a7f55d-a4e2-47dc-a4b8-f982ab030a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:50.159936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 106/211] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:50.189456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7239e-645c-41d8-93cd-0ebd4823efa2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:50.207288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 106/212] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:50.233677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f55d-a4e2-47dc-a4b8-f982ab030a38 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:50.343912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7239e-645c-41d8-93cd-0ebd4823efa2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:50.387036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f55d-a4e2-47dc-a4b8-f982ab030a38 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:50.390642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552830-a759-4e9d-91e6-d6256b1d4887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:50.391303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552830-a759-4e9d-91e6-d6256b1d4887 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.391588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552830-a759-4e9d-91e6-d6256b1d4887 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.391860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552830-a759-4e9d-91e6-d6256b1d4887 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.393014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2552830-a759-4e9d-91e6-d6256b1d4887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:50.394493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2552830-a759-4e9d-91e6-d6256b1d4887 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:50.396758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 107/213] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:50.402217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552830-a759-4e9d-91e6-d6256b1d4887 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:50.404234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:50.428442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220210e-2836-4e92-8f52-fe4c541c18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:50.429080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220210e-2836-4e92-8f52-fe4c541c18f2 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.429357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220210e-2836-4e92-8f52-fe4c541c18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.429624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220210e-2836-4e92-8f52-fe4c541c18f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.442412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220210e-2836-4e92-8f52-fe4c541c18f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:50.447546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-3220210e-2836-4e92-8f52-fe4c541c18f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:50.448883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:50.449729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:50.450544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 107/214] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:50.455784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220210e-2836-4e92-8f52-fe4c541c18f2 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:50.512449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552830-a759-4e9d-91e6-d6256b1d4887 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:50.548084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdd991-260c-4611-a26f-49d285b3c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:50.548979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdd991-260c-4611-a26f-49d285b3c8ab None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.549303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdd991-260c-4611-a26f-49d285b3c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.549571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdd991-260c-4611-a26f-49d285b3c8ab None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.550271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdd991-260c-4611-a26f-49d285b3c8ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:50.552284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdd991-260c-4611-a26f-49d285b3c8ab None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:50.564455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220210e-2836-4e92-8f52-fe4c541c18f2 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:50.608006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:50.608705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.609051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.609327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.610056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:50.610361 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:50.611820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:50.621137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 108/215] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:50.626367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:50.662033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:50.676214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 108/216] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:22:50 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:50.752839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2aeb-735c-42b1-a9b1-fec7a02daddb None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:50.790443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20ce94-6c99-4ef9-94b9-a1542cf940c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:50.791034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ce94-6c99-4ef9-94b9-a1542cf940c4 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.791358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ce94-6c99-4ef9-94b9-a1542cf940c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.791634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ce94-6c99-4ef9-94b9-a1542cf940c4 None admin] PATH_INFO: `/v3/users/ef404394d55745d1979a25f4724bb238` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:50.812504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20ce94-6c99-4ef9-94b9-a1542cf940c4 None admin] RBAC: Authorizing `identity:get_user(user_id=ef404394d55745d1979a25f4724bb238)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:50.814456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20ce94-6c99-4ef9-94b9-a1542cf940c4 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:50.816842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 109/217] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:50 2022] GET /identity/v3/users/ef404394d55745d1979a25f4724bb238 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:50.822480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdd991-260c-4611-a26f-49d285b3c8ab None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:50.924600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:50.931945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdd991-260c-4611-a26f-49d285b3c8ab None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:50.969679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985687-728b-4883-ae1b-658cf30861a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:50.970306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985687-728b-4883-ae1b-658cf30861a4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:50.970640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985687-728b-4883-ae1b-658cf30861a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:50.971025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985687-728b-4883-ae1b-658cf30861a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.002338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3deb-261e-4ca4-954a-08e6ac32acec None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.002711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3deb-261e-4ca4-954a-08e6ac32acec None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.002988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3deb-261e-4ca4-954a-08e6ac32acec None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.004615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 110/218] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:51.011042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1064d-62f8-4d1b-8d33-02bcfc9f174f None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.011313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1064d-62f8-4d1b-8d33-02bcfc9f174f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.011593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1064d-62f8-4d1b-8d33-02bcfc9f174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.033359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-45b1064d-62f8-4d1b-8d33-02bcfc9f174f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:51.034709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-45b1064d-62f8-4d1b-8d33-02bcfc9f174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:51.056168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985687-728b-4883-ae1b-658cf30861a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:51.058703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985687-728b-4883-ae1b-658cf30861a4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:51.126968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 111/219] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:51.159728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1064d-62f8-4d1b-8d33-02bcfc9f174f None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:51.178496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:51.187741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 109/220] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:51.195590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985687-728b-4883-ae1b-658cf30861a4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:51.211552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:51.329564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985687-728b-4883-ae1b-658cf30861a4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:51.337514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1064d-62f8-4d1b-8d33-02bcfc9f174f None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:51.371881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b6e30-cdca-484d-ae2c-5e0311a76c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:51.372526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b6e30-cdca-484d-ae2c-5e0311a76c85 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.372804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b6e30-cdca-484d-ae2c-5e0311a76c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.373085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b6e30-cdca-484d-ae2c-5e0311a76c85 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.374214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b6e30-cdca-484d-ae2c-5e0311a76c85 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:51.375690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b6e30-cdca-484d-ae2c-5e0311a76c85 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:51.377339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 110/221] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:51 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:51.387556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b6e30-cdca-484d-ae2c-5e0311a76c85 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:51.397631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29ad1-aed4-43c4-bc76-b2769eb50c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:51.398895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29ad1-aed4-43c4-bc76-b2769eb50c8c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.399352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29ad1-aed4-43c4-bc76-b2769eb50c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.399829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29ad1-aed4-43c4-bc76-b2769eb50c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.416057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb29ad1-aed4-43c4-bc76-b2769eb50c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-ebb29ad1-aed4-43c4-bc76-b2769eb50c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:51.423581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:51.424463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:51.425266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:51.428638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 112/222] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:51.434904 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29ad1-aed4-43c4-bc76-b2769eb50c8c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:51.504488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:51.542775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:51.552201 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b6e30-cdca-484d-ae2c-5e0311a76c85 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:51.561245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29ad1-aed4-43c4-bc76-b2769eb50c8c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:51.598318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594de79-27a3-4b3c-8fb0-956534147076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:51.599245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594de79-27a3-4b3c-8fb0-956534147076 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.599693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594de79-27a3-4b3c-8fb0-956534147076 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.600107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594de79-27a3-4b3c-8fb0-956534147076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.600852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:51.601197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594de79-27a3-4b3c-8fb0-956534147076 None admin] RBAC: Adding query filter params (role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=ee1d1fb582804a18bbe932f7917df50c, user.id=ef404394d55745d1979a25f4724bb238) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:51.601645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594de79-27a3-4b3c-8fb0-956534147076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:51.601768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.602091 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.602451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.603236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:51.603631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:51.604001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594de79-27a3-4b3c-8fb0-956534147076 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:51.605251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:51.617881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 111/223] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:51 2022] GET /identity/v3/role_assignments?user.id=ef404394d55745d1979a25f4724bb238&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=4851e677104948daa4c8bcf195bd8608 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:51.617881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f960e2-faa0-40ef-adbd-49d2939ef71e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.617881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f960e2-faa0-40ef-adbd-49d2939ef71e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.617881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f960e2-faa0-40ef-adbd-49d2939ef71e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.623142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 112/224] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:51.624579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8533259-51ca-4846-981c-dba2c9bfec8a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.624864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8533259-51ca-4846-981c-dba2c9bfec8a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.625139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8533259-51ca-4846-981c-dba2c9bfec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.628851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 113/225] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:51.634609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:51.658751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a8533259-51ca-4846-981c-dba2c9bfec8a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:51.660053 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a8533259-51ca-4846-981c-dba2c9bfec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:51.761717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfda1b5-fd8d-4689-b3c3-5a64e52c7c50 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:51.802538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068646bf-24ca-4353-b4d2-d9736caeedda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:51.803710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068646bf-24ca-4353-b4d2-d9736caeedda None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:51.804191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068646bf-24ca-4353-b4d2-d9736caeedda None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:51.804660 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068646bf-24ca-4353-b4d2-d9736caeedda None admin] PATH_INFO: `/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:51.806173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068646bf-24ca-4353-b4d2-d9736caeedda None admin] RBAC: Authorizing `identity:get_user(user_id=cd37a1dcf3eb4f38bcc22142a655aab3)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:51.808824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068646bf-24ca-4353-b4d2-d9736caeedda None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:51.810945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 114/226] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:51 2022] GET /identity/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:51.820187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068646bf-24ca-4353-b4d2-d9736caeedda None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:51.837688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 113/227] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:51.847409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:51.861358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8533259-51ca-4846-981c-dba2c9bfec8a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:51.920903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:51.960189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068646bf-24ca-4353-b4d2-d9736caeedda None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:51.998358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b81835-6af2-4210-8462-700657fc86c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:51.999640 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81835-6af2-4210-8462-700657fc86c7 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:52.000342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81835-6af2-4210-8462-700657fc86c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:52.001018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81835-6af2-4210-8462-700657fc86c7 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:52.002992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b81835-6af2-4210-8462-700657fc86c7 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:52.008280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b81835-6af2-4210-8462-700657fc86c7 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:52.013870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 115/228] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:51 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:52.023502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b81835-6af2-4210-8462-700657fc86c7 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:52.025251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8533259-51ca-4846-981c-dba2c9bfec8a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:52.068641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c1338-553b-4e7c-b9f8-c8af147eb82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:52.069281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1338-553b-4e7c-b9f8-c8af147eb82b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:52.069554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1338-553b-4e7c-b9f8-c8af147eb82b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:52.069821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c1338-553b-4e7c-b9f8-c8af147eb82b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:52.096709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c1338-553b-4e7c-b9f8-c8af147eb82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-764c1338-553b-4e7c-b9f8-c8af147eb82b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:52.103083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:52.103997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:52.104874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:52.112612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 114/229] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:22:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:52.116900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c1338-553b-4e7c-b9f8-c8af147eb82b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:52.159180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:52.179090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b81835-6af2-4210-8462-700657fc86c7 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:52.232847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165e52b-5cc3-4fa3-be2e-07cfc7575983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:52.233888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165e52b-5cc3-4fa3-be2e-07cfc7575983 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:52.234549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165e52b-5cc3-4fa3-be2e-07cfc7575983 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:52.235683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165e52b-5cc3-4fa3-be2e-07cfc7575983 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c/users/cd37a1dcf3eb4f38bcc22142a655aab3/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:52.240288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165e52b-5cc3-4fa3-be2e-07cfc7575983 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d1fb582804a18bbe932f7917df50c, user_id=cd37a1dcf3eb4f38bcc22142a655aab3, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:52.242915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165e52b-5cc3-4fa3-be2e-07cfc7575983 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:52.295012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c1338-553b-4e7c-b9f8-c8af147eb82b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:52.317431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:52.337667 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:52.338844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:52.339398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:52.339896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:52.340865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:52.341368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:52.342987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:52.352192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 115/230] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:22:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:52.359461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:52.393774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 116/231] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:52 2022] PUT /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c/users/cd37a1dcf3eb4f38bcc22142a655aab3/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:52.476203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbba6e-54bd-4f0d-8c38-0d3716426ebc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:52.512999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecae76-54e6-46b4-85fa-0502f6a632e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:52.513757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecae76-54e6-46b4-85fa-0502f6a632e3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:52.513978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecae76-54e6-46b4-85fa-0502f6a632e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:52.514254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecae76-54e6-46b4-85fa-0502f6a632e3 None admin] PATH_INFO: `/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:52.515477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecae76-54e6-46b4-85fa-0502f6a632e3 None admin] RBAC: Authorizing `identity:get_user(user_id=cd37a1dcf3eb4f38bcc22142a655aab3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:52.516982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecae76-54e6-46b4-85fa-0502f6a632e3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:52.519177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 116/232] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:52 2022] GET /identity/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:52.524732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165e52b-5cc3-4fa3-be2e-07cfc7575983 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:52.631812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165e52b-5cc3-4fa3-be2e-07cfc7575983 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:52.674759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073ac3b-5a00-4c8b-9304-b95b827b6aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:52.675397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073ac3b-5a00-4c8b-9304-b95b827b6aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:52.675671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073ac3b-5a00-4c8b-9304-b95b827b6aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:52.675938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073ac3b-5a00-4c8b-9304-b95b827b6aa7 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:52.677113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073ac3b-5a00-4c8b-9304-b95b827b6aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:52.678635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073ac3b-5a00-4c8b-9304-b95b827b6aa7 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:52.680374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 117/233] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:52 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:52.686939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecae76-54e6-46b4-85fa-0502f6a632e3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:52.739722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:52.793113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecae76-54e6-46b4-85fa-0502f6a632e3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:52.829101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55a8d7-71cc-44da-ac15-a4eb3777a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:52.829768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a8d7-71cc-44da-ac15-a4eb3777a84b None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:52.830044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a8d7-71cc-44da-ac15-a4eb3777a84b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:52.830317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a8d7-71cc-44da-ac15-a4eb3777a84b None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c/users/cd37a1dcf3eb4f38bcc22142a655aab3/roles/1cb2ff0f0c514fc19e6847a5c8e3a127` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:52.832510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55a8d7-71cc-44da-ac15-a4eb3777a84b None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d1fb582804a18bbe932f7917df50c, user_id=cd37a1dcf3eb4f38bcc22142a655aab3, role_id=1cb2ff0f0c514fc19e6847a5c8e3a127)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:52.833951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55a8d7-71cc-44da-ac15-a4eb3777a84b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:52.912908 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 117/234] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:52 2022] PUT /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c/users/cd37a1dcf3eb4f38bcc22142a655aab3/roles/1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:53.234829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fc3a1-2201-4937-84aa-9bf2b17f2915 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:53.235433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fc3a1-2201-4937-84aa-9bf2b17f2915 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:53.235928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fc3a1-2201-4937-84aa-9bf2b17f2915 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:53.237726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 118/235] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:53.242821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4299ab-8c89-44f6-a987-bfd16172cea3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:53.243102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4299ab-8c89-44f6-a987-bfd16172cea3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:53.243374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4299ab-8c89-44f6-a987-bfd16172cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:53.256956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f387a8-cb6c-44e1-ad59-24f4df923ffe None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:53.257250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f387a8-cb6c-44e1-ad59-24f4df923ffe None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:53.257503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f387a8-cb6c-44e1-ad59-24f4df923ffe None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:53.258927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 119/236] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:53.267410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5e4299ab-8c89-44f6-a987-bfd16172cea3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:53.268726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5e4299ab-8c89-44f6-a987-bfd16172cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:53.269556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41f979-8007-4b27-87f4-a7327033df2a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:53.269881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41f979-8007-4b27-87f4-a7327033df2a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:53.270293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41f979-8007-4b27-87f4-a7327033df2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:53.301724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ee41f979-8007-4b27-87f4-a7327033df2a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:53.302948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ee41f979-8007-4b27-87f4-a7327033df2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:53.318808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:53.390238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 118/237] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:53.422068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 120/238] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:53.450039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4299ab-8c89-44f6-a987-bfd16172cea3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:53.485816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41f979-8007-4b27-87f4-a7327033df2a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:53.505939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:53.599517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41f979-8007-4b27-87f4-a7327033df2a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:53.606209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4299ab-8c89-44f6-a987-bfd16172cea3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:53.641177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9064d8-9136-40dc-85e3-a6c0229679ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:53.642978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9064d8-9136-40dc-85e3-a6c0229679ce None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:53.646029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9064d8-9136-40dc-85e3-a6c0229679ce None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:53.648440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9064d8-9136-40dc-85e3-a6c0229679ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:53.649885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9064d8-9136-40dc-85e3-a6c0229679ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:53.652205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9064d8-9136-40dc-85e3-a6c0229679ce None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:53.655002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 121/239] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:53.660594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9064d8-9136-40dc-85e3-a6c0229679ce None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:53.681518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95f869-c9be-4c12-9e61-da7db76d0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:53.682499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f869-c9be-4c12-9e61-da7db76d0cbb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:53.682826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:53.682955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f869-c9be-4c12-9e61-da7db76d0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:53.683227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f869-c9be-4c12-9e61-da7db76d0cbb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:53.705550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95f869-c9be-4c12-9e61-da7db76d0cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2a95f869-c9be-4c12-9e61-da7db76d0cbb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:53.710356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:53.714872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:53.715669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:53.718074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 119/240] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:53.718878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95f869-c9be-4c12-9e61-da7db76d0cbb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:53.832221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9064d8-9136-40dc-85e3-a6c0229679ce None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:53.876436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802208b-2738-4514-9458-ca5af59b0d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:53.877965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802208b-2738-4514-9458-ca5af59b0d22 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:53.878244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802208b-2738-4514-9458-ca5af59b0d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:53.882582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802208b-2738-4514-9458-ca5af59b0d22 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:53.883482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802208b-2738-4514-9458-ca5af59b0d22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:53.885079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802208b-2738-4514-9458-ca5af59b0d22 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:53.904987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:53.913467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95f869-c9be-4c12-9e61-da7db76d0cbb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:53.953213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:53.954021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:53.954450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:53.955003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:53.955819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:53.956282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:53.957877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:53.967000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 120/241] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:53.973391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:54.009149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 122/242] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:22:53 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:54.079291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fda1d-92e5-4403-8eed-f4c67657894d None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.079570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fda1d-92e5-4403-8eed-f4c67657894d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.079845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fda1d-92e5-4403-8eed-f4c67657894d None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.081419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 123/243] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:54.086772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27436bf1-3253-4ea1-8c57-38d38836189d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.086970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27436bf1-3253-4ea1-8c57-38d38836189d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.087238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27436bf1-3253-4ea1-8c57-38d38836189d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.102694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93568-b0bd-4d1b-9b42-b9067fc4cc75 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:54.106976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-27436bf1-3253-4ea1-8c57-38d38836189d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:54.108266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-27436bf1-3253-4ea1-8c57-38d38836189d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:54.181897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:54.187228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f26a76-be6e-4563-83d8-bb2598f95515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:54.187893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f26a76-be6e-4563-83d8-bb2598f95515 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.188169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f26a76-be6e-4563-83d8-bb2598f95515 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.188518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f26a76-be6e-4563-83d8-bb2598f95515 None admin] PATH_INFO: `/v3/users/1079c7cb0eb94eadb8d21497c3f0d3c2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.190262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 124/244] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:54.212080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f26a76-be6e-4563-83d8-bb2598f95515 None admin] RBAC: Authorizing `identity:get_user(user_id=1079c7cb0eb94eadb8d21497c3f0d3c2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:54.214124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f26a76-be6e-4563-83d8-bb2598f95515 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:54.216043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 121/245] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:53 2022] GET /identity/v3/users/1079c7cb0eb94eadb8d21497c3f0d3c2 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:54.219199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27436bf1-3253-4ea1-8c57-38d38836189d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:54.221071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f26a76-be6e-4563-83d8-bb2598f95515 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:54.246870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:54.352849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27436bf1-3253-4ea1-8c57-38d38836189d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:54.358360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f26a76-be6e-4563-83d8-bb2598f95515 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:54.401050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12adeb0-6c02-47cf-9e0c-c743a63c5973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:54.401743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12adeb0-6c02-47cf-9e0c-c743a63c5973 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.402111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12adeb0-6c02-47cf-9e0c-c743a63c5973 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.402376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12adeb0-6c02-47cf-9e0c-c743a63c5973 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.409027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6e88-a9f2-493f-a362-073e348fd5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:54.410208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6e88-a9f2-493f-a362-073e348fd5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.411088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6e88-a9f2-493f-a362-073e348fd5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.411593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6e88-a9f2-493f-a362-073e348fd5d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.416284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12adeb0-6c02-47cf-9e0c-c743a63c5973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-e12adeb0-6c02-47cf-9e0c-c743a63c5973 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:54.420825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:54.421784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:54.422609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 125/246] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:54.428216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12adeb0-6c02-47cf-9e0c-c743a63c5973 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:54.501600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d6e88-a9f2-493f-a362-073e348fd5d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:54.502274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:54.505320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d6e88-a9f2-493f-a362-073e348fd5d1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:54.526825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:54.556911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12adeb0-6c02-47cf-9e0c-c743a63c5973 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:54.604126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:54.605286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.605578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.605922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.606987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:54.607131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:54.608690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:54.618299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 126/247] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:54.624839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:54.633784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 122/248] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:22:54.639882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6e88-a9f2-493f-a362-073e348fd5d1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:54.744136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6e88-a9f2-493f-a362-073e348fd5d1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:54.744790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e682b-a2ed-4d0b-bb5f-a7c15c1f3b55 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:54.764170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:54.765800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:54.783846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cb299-9886-42ee-a345-252179cb0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:54.784873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cb299-9886-42ee-a345-252179cb0141 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.785027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783cc1-53ec-458f-8c8e-f20e46085518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:54.785485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cb299-9886-42ee-a345-252179cb0141 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.785860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783cc1-53ec-458f-8c8e-f20e46085518 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.786117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cb299-9886-42ee-a345-252179cb0141 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.786229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783cc1-53ec-458f-8c8e-f20e46085518 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.786566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783cc1-53ec-458f-8c8e-f20e46085518 None admin] PATH_INFO: `/v3/users/ef404394d55745d1979a25f4724bb238` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.788026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783cc1-53ec-458f-8c8e-f20e46085518 None admin] RBAC: Authorizing `identity:get_user(user_id=ef404394d55745d1979a25f4724bb238)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:54.788864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cb299-9886-42ee-a345-252179cb0141 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:54.789490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783cc1-53ec-458f-8c8e-f20e46085518 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:54.790722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cb299-9886-42ee-a345-252179cb0141 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:54.791485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 127/249] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:54 2022] GET /identity/v3/users/ef404394d55745d1979a25f4724bb238 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:54.793794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 123/250] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:54 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:54.797839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783cc1-53ec-458f-8c8e-f20e46085518 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:54.799821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cb299-9886-42ee-a345-252179cb0141 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:54.908598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cb299-9886-42ee-a345-252179cb0141 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:54.914681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783cc1-53ec-458f-8c8e-f20e46085518 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:54.951296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e867-eb03-4ee3-8d69-320eaee57bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:54.952178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e867-eb03-4ee3-8d69-320eaee57bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.952691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e867-eb03-4ee3-8d69-320eaee57bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.953228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e867-eb03-4ee3-8d69-320eaee57bf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.954139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e867-eb03-4ee3-8d69-320eaee57bf1 None admin] RBAC: Adding query filter params (role.id=09d6cbb5feda48f389570c916edfda07, scope.project.id=ee1d1fb582804a18bbe932f7917df50c, user.id=1079c7cb0eb94eadb8d21497c3f0d3c2) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:54.954647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e867-eb03-4ee3-8d69-320eaee57bf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:54.954751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188954d-646c-4874-b4db-4c05d67757ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:54.955386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188954d-646c-4874-b4db-4c05d67757ab None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:54.955772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188954d-646c-4874-b4db-4c05d67757ab None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:54.956122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188954d-646c-4874-b4db-4c05d67757ab None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:54.956957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e867-eb03-4ee3-8d69-320eaee57bf1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:54.957463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188954d-646c-4874-b4db-4c05d67757ab None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:54.959907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188954d-646c-4874-b4db-4c05d67757ab None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:54.960851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 128/251] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:54 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:54.965466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 124/252] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:54 2022] GET /identity/v3/role_assignments?user.id=1079c7cb0eb94eadb8d21497c3f0d3c2&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=09d6cbb5feda48f389570c916edfda07 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:54.967600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188954d-646c-4874-b4db-4c05d67757ab None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:55.030384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:55.062589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d1ba0-4d39-4001-9883-30c537acea8e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:55.062927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d1ba0-4d39-4001-9883-30c537acea8e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:55.064776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d1ba0-4d39-4001-9883-30c537acea8e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:55.066235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 125/253] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:55.073509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bbee9-cee5-4e24-8e68-7370c6cb6576 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:55.073816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bbee9-cee5-4e24-8e68-7370c6cb6576 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:55.074052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bbee9-cee5-4e24-8e68-7370c6cb6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:55.087695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188954d-646c-4874-b4db-4c05d67757ab None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:55.098255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-639bbee9-cee5-4e24-8e68-7370c6cb6576 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:55.100006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-639bbee9-cee5-4e24-8e68-7370c6cb6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:55.154206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:55.168023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4a0c-c552-41c2-9135-d94a5c3cf572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:55.168023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4a0c-c552-41c2-9135-d94a5c3cf572 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:55.168023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4a0c-c552-41c2-9135-d94a5c3cf572 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:55.168023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4a0c-c552-41c2-9135-d94a5c3cf572 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c/users/ef404394d55745d1979a25f4724bb238/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:55.168396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4a0c-c552-41c2-9135-d94a5c3cf572 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d1fb582804a18bbe932f7917df50c, user_id=ef404394d55745d1979a25f4724bb238, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:55.168396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4a0c-c552-41c2-9135-d94a5c3cf572 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:55.186406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 126/254] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:55.211709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bbee9-cee5-4e24-8e68-7370c6cb6576 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:55.255087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 129/255] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:54 2022] PUT /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c/users/ef404394d55745d1979a25f4724bb238/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:22:55.357119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bbee9-cee5-4e24-8e68-7370c6cb6576 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:55.400922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd23fc1-58ea-4aa3-824a-cfd9e7b1318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:55.401641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd23fc1-58ea-4aa3-824a-cfd9e7b1318b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:55.401921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd23fc1-58ea-4aa3-824a-cfd9e7b1318b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:55.402193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd23fc1-58ea-4aa3-824a-cfd9e7b1318b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:55.423930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd23fc1-58ea-4aa3-824a-cfd9e7b1318b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bdd23fc1-58ea-4aa3-824a-cfd9e7b1318b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:55.428932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:55.429849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:55.430683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 127/256] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:22:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:55.437340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4a0c-c552-41c2-9135-d94a5c3cf572 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:55.564014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64480d1-a353-40bb-b585-de08f0fc6b7f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:55.564297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64480d1-a353-40bb-b585-de08f0fc6b7f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:55.564578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64480d1-a353-40bb-b585-de08f0fc6b7f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:55.566071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 128/257] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:55.571726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51336d2-b42e-4cd4-aeca-36ac70addfdd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:55.572005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51336d2-b42e-4cd4-aeca-36ac70addfdd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:55.572278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51336d2-b42e-4cd4-aeca-36ac70addfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:55.601136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4a0c-c552-41c2-9135-d94a5c3cf572 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:55.607554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b51336d2-b42e-4cd4-aeca-36ac70addfdd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:55.612996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b51336d2-b42e-4cd4-aeca-36ac70addfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:55.628263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:55.670851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:55.671359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:55.671614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:55.671863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:55.672137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:55.672815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:55.673125 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:55.674591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:55.696802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 130/258] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:55.702856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:55.748995 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 129/259] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:55.774445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51336d2-b42e-4cd4-aeca-36ac70addfdd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:55.905682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b4052-5dc1-410c-b2d0-0c256c13a530 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:55.998024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58946d55-daf0-4204-8f28-9d626834cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:55.998693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58946d55-daf0-4204-8f28-9d626834cba0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:55.998969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58946d55-daf0-4204-8f28-9d626834cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:55.999236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58946d55-daf0-4204-8f28-9d626834cba0 None admin] PATH_INFO: `/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:56.000425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58946d55-daf0-4204-8f28-9d626834cba0 None admin] RBAC: Authorizing `identity:get_user(user_id=cd37a1dcf3eb4f38bcc22142a655aab3)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:56.001867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58946d55-daf0-4204-8f28-9d626834cba0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:56.003483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 131/260] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:55 2022] GET /identity/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3 => generated 283 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:56.009078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58946d55-daf0-4204-8f28-9d626834cba0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:56.033902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51336d2-b42e-4cd4-aeca-36ac70addfdd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:56.115320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:56.117169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ebaf4-caa0-4aaf-8ce0-5d9dae85f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:56.117813 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ebaf4-caa0-4aaf-8ce0-5d9dae85f61a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:56.118088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ebaf4-caa0-4aaf-8ce0-5d9dae85f61a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:56.118355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ebaf4-caa0-4aaf-8ce0-5d9dae85f61a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:56.144231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ebaf4-caa0-4aaf-8ce0-5d9dae85f61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-085ebaf4-caa0-4aaf-8ce0-5d9dae85f61a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:56.149011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:56.149968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:22:56.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:56.153028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 130/261] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:22:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:56.160259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ebaf4-caa0-4aaf-8ce0-5d9dae85f61a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:56.231536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:56.237388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58946d55-daf0-4204-8f28-9d626834cba0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:56.300769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79571ea8-4380-404c-98dc-ac93b1f78deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:56.301384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571ea8-4380-404c-98dc-ac93b1f78deb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:56.301662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571ea8-4380-404c-98dc-ac93b1f78deb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:56.301933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571ea8-4380-404c-98dc-ac93b1f78deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:56.387478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ebaf4-caa0-4aaf-8ce0-5d9dae85f61a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:56.428662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79571ea8-4380-404c-98dc-ac93b1f78deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:56.430267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79571ea8-4380-404c-98dc-ac93b1f78deb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:56.476400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:56.477031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:56.477309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:56.477582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:56.478262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:56.478588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:56.480624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:56.498623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 131/262] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:56.499818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:56.503932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:56.593647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 132/263] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:22:56.599056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79571ea8-4380-404c-98dc-ac93b1f78deb None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:56.646825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:56.659116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d619fb-5a2a-49c8-b756-a9b92252902f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:56.716560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8554ea0-84a2-4d3e-a877-91cbe171bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:56.717204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554ea0-84a2-4d3e-a877-91cbe171bdcd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:56.717465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554ea0-84a2-4d3e-a877-91cbe171bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:56.717951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554ea0-84a2-4d3e-a877-91cbe171bdcd None admin] PATH_INFO: `/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:56.720338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8554ea0-84a2-4d3e-a877-91cbe171bdcd None admin] RBAC: Authorizing `identity:get_user(user_id=cd37a1dcf3eb4f38bcc22142a655aab3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:56.721993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8554ea0-84a2-4d3e-a877-91cbe171bdcd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:56.727835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 132/264] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:56 2022] GET /identity/v3/users/cd37a1dcf3eb4f38bcc22142a655aab3 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:56.733367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8554ea0-84a2-4d3e-a877-91cbe171bdcd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:56.779656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79571ea8-4380-404c-98dc-ac93b1f78deb None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:56.835241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e9cca-ee29-496d-b0f4-d6d71081beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:56.836154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e9cca-ee29-496d-b0f4-d6d71081beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:56.836609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e9cca-ee29-496d-b0f4-d6d71081beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:56.837025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e9cca-ee29-496d-b0f4-d6d71081beb1 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:56.839250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e9cca-ee29-496d-b0f4-d6d71081beb1 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:56.840902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e9cca-ee29-496d-b0f4-d6d71081beb1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:56.842834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 133/265] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:56 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:56.850521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e9cca-ee29-496d-b0f4-d6d71081beb1 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:56.866609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:56.958328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8554ea0-84a2-4d3e-a877-91cbe171bdcd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:56.995168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14b56-1cbf-4968-b83f-b9733071e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:56.995798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14b56-1cbf-4968-b83f-b9733071e4ef None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:56.996081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14b56-1cbf-4968-b83f-b9733071e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:56.996355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14b56-1cbf-4968-b83f-b9733071e4ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.022826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e9cca-ee29-496d-b0f4-d6d71081beb1 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:57.038734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:57.078159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b14b56-1cbf-4968-b83f-b9733071e4ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:57.079703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b14b56-1cbf-4968-b83f-b9733071e4ef None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:57.099913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:57.100525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:57.100803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:57.101074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.101816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=ee1d1fb582804a18bbe932f7917df50c, user.id=cd37a1dcf3eb4f38bcc22142a655aab3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:57.102123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:57.103586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:57.121422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 134/266] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:56 2022] GET /identity/v3/role_assignments?user.id=cd37a1dcf3eb4f38bcc22142a655aab3&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=45149274288845b0a73e18fbb3394202 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:57.239001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 133/267] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:22:57.247566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:57.346188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:57.381192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86114439-6b1a-4697-b713-e3714341c228 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:57.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9e8a2-6979-4745-a08a-044b26d09a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:57.427475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e8a2-6979-4745-a08a-044b26d09a2b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:57.427752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e8a2-6979-4745-a08a-044b26d09a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:57.428023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e8a2-6979-4745-a08a-044b26d09a2b None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.435197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9e8a2-6979-4745-a08a-044b26d09a2b None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:57.436691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9e8a2-6979-4745-a08a-044b26d09a2b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:57.438621 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 135/268] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:57 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:57.444347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14b56-1cbf-4968-b83f-b9733071e4ef None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:57.453148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832759cd-6464-4897-af9e-9b88eeb81c48 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:57.453434 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832759cd-6464-4897-af9e-9b88eeb81c48 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:57.453708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832759cd-6464-4897-af9e-9b88eeb81c48 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.455428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 136/269] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:57.461058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d445-7ef1-45e6-8d9e-25fdcdc4e5ec None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:57.461332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d445-7ef1-45e6-8d9e-25fdcdc4e5ec None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:57.461607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d445-7ef1-45e6-8d9e-25fdcdc4e5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.494637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9f73d445-7ef1-45e6-8d9e-25fdcdc4e5ec None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:57.495906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9f73d445-7ef1-45e6-8d9e-25fdcdc4e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:57.538904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:57.596467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 137/270] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:57.625239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14b56-1cbf-4968-b83f-b9733071e4ef None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:57.632726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73d445-7ef1-45e6-8d9e-25fdcdc4e5ec None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:57.688947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deca49-b3f6-40c1-8322-030441861ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:57.689564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deca49-b3f6-40c1-8322-030441861ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:57.689842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deca49-b3f6-40c1-8322-030441861ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:57.690114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deca49-b3f6-40c1-8322-030441861ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.690876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1deca49-b3f6-40c1-8322-030441861ec2 None admin] RBAC: Adding query filter params (role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=ee1d1fb582804a18bbe932f7917df50c, user.id=cd37a1dcf3eb4f38bcc22142a655aab3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:57.691186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1deca49-b3f6-40c1-8322-030441861ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:57.692637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1deca49-b3f6-40c1-8322-030441861ec2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:57.709928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 134/271] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:57 2022] GET /identity/v3/role_assignments?user.id=cd37a1dcf3eb4f38bcc22142a655aab3&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:57.753827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:57.795504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73d445-7ef1-45e6-8d9e-25fdcdc4e5ec None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:57.844934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19ab1b-958d-475a-a8c7-baaa34122446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:57.845579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ab1b-958d-475a-a8c7-baaa34122446 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:57.845855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ab1b-958d-475a-a8c7-baaa34122446 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:57.846089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765ea5b-6f06-4f1b-a0bd-ddba7fda286f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:57.846580 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ab1b-958d-475a-a8c7-baaa34122446 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.846665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765ea5b-6f06-4f1b-a0bd-ddba7fda286f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:57.846665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765ea5b-6f06-4f1b-a0bd-ddba7fda286f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.848003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 135/272] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:22:57.857374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576c45-b706-4ccf-b427-10d1f3dd9038 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:57.857656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576c45-b706-4ccf-b427-10d1f3dd9038 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:57.857930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576c45-b706-4ccf-b427-10d1f3dd9038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:57.862763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19ab1b-958d-475a-a8c7-baaa34122446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-da19ab1b-958d-475a-a8c7-baaa34122446 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:57.868286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:57.869238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:57.870639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:57.872830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 138/273] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:22:57.881461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19ab1b-958d-475a-a8c7-baaa34122446 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:57.899675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a9576c45-b706-4ccf-b427-10d1f3dd9038 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:57.900880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a9576c45-b706-4ccf-b427-10d1f3dd9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:57.998246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19ab1b-958d-475a-a8c7-baaa34122446 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:58.035822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:58.039398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 136/274] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:22:58.048008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:58.048632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.048912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.049180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.049856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:58.050186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:58.051581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:58.060663 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 139/275] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:58.064576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9576c45-b706-4ccf-b427-10d1f3dd9038 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:58.069617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:58.122480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:58.175615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9576c45-b706-4ccf-b427-10d1f3dd9038 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:58.201469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09195d3-0c9c-41ec-8404-39fa5641f6d5 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:58.212909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cf4d9-b6fe-4cf0-abef-8c56016d011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:58.214148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cf4d9-b6fe-4cf0-abef-8c56016d011e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.214417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cf4d9-b6fe-4cf0-abef-8c56016d011e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.214715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cf4d9-b6fe-4cf0-abef-8c56016d011e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.215817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cf4d9-b6fe-4cf0-abef-8c56016d011e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:58.217258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cf4d9-b6fe-4cf0-abef-8c56016d011e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:58.219030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 137/276] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:58.223741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17576a6f-c380-4312-bda1-fb43c1b0c929 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.224029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17576a6f-c380-4312-bda1-fb43c1b0c929 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.224365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17576a6f-c380-4312-bda1-fb43c1b0c929 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.226091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 138/277] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:58.226829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db63d2-988e-4fa8-a48b-b7088af4e138 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.227112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db63d2-988e-4fa8-a48b-b7088af4e138 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.227382 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db63d2-988e-4fa8-a48b-b7088af4e138 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.228689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 139/278] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:22:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:22:58.231245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db63d2-988e-4fa8-a48b-b7088af4e138 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:58.236986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991e5a5-38da-4b53-b72b-9f9ade0fe198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:58.237609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991e5a5-38da-4b53-b72b-9f9ade0fe198 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.237879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991e5a5-38da-4b53-b72b-9f9ade0fe198 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.238142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991e5a5-38da-4b53-b72b-9f9ade0fe198 None admin] PATH_INFO: `/v3/users/f155904873ba4c5499b451856296a715` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.251903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991e5a5-38da-4b53-b72b-9f9ade0fe198 None admin] RBAC: Authorizing `identity:get_user(user_id=f155904873ba4c5499b451856296a715)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:58.253366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991e5a5-38da-4b53-b72b-9f9ade0fe198 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:58.255140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 140/279] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:58 2022] GET /identity/v3/users/f155904873ba4c5499b451856296a715 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:22:58.256441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b2f5-368f-44ad-8cd6-6c309a53603c None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.256724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b2f5-368f-44ad-8cd6-6c309a53603c None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.256994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b2f5-368f-44ad-8cd6-6c309a53603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.274331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b195b2f5-368f-44ad-8cd6-6c309a53603c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:58.275549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b195b2f5-368f-44ad-8cd6-6c309a53603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:58.320500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:58.335341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db63d2-988e-4fa8-a48b-b7088af4e138 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:58.340528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 141/280] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:58.341715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed590fa-084f-4b52-9c62-e79ee775785d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.342001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed590fa-084f-4b52-9c62-e79ee775785d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.342271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed590fa-084f-4b52-9c62-e79ee775785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.359974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:58.362322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8ed590fa-084f-4b52-9c62-e79ee775785d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:22:58.363545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8ed590fa-084f-4b52-9c62-e79ee775785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:22:58.374395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc8ab8-2604-45b9-bfa2-3a5af4848e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:58.374971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc8ab8-2604-45b9-bfa2-3a5af4848e1c None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.375251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc8ab8-2604-45b9-bfa2-3a5af4848e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.375529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc8ab8-2604-45b9-bfa2-3a5af4848e1c None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.376190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc8ab8-2604-45b9-bfa2-3a5af4848e1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:58.377637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc8ab8-2604-45b9-bfa2-3a5af4848e1c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:58.428684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 142/281] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:22:58.429495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed590fa-084f-4b52-9c62-e79ee775785d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:58.478507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 140/282] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:22:58 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:22:58.478507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc8ab8-2604-45b9-bfa2-3a5af4848e1c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:58.533591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed590fa-084f-4b52-9c62-e79ee775785d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:58.549237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:58.574918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:58.575897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.576481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.576760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.577514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] RBAC: Adding query filter params (role.id=4851e677104948daa4c8bcf195bd8608, user.id=f155904873ba4c5499b451856296a715, scope.system=all) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:58.577833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:58.579809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:58.594495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 143/283] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Aug 10 08:22:58 2022] GET /identity/v3/role_assignments?user.id=f155904873ba4c5499b451856296a715&scope.system=all&role.id=4851e677104948daa4c8bcf195bd8608 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:58.594495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:58.601890 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc8ab8-2604-45b9-bfa2-3a5af4848e1c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:58.649560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a3995-e514-4fdf-be76-36c747ded3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:58.650135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3995-e514-4fdf-be76-36c747ded3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.650407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3995-e514-4fdf-be76-36c747ded3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.650827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3995-e514-4fdf-be76-36c747ded3b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.668342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a3995-e514-4fdf-be76-36c747ded3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4e0a3995-e514-4fdf-be76-36c747ded3b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:58.675425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:58.676503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:22:58.677300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 141/284] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:58.685702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a3995-e514-4fdf-be76-36c747ded3b8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:58.748780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:58.751143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54b5eb-322d-41df-9f8a-0fff61a1aec0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:58.808143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f9b9-5ee1-4a3a-a63a-1b19e5cdb2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:58.809474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f9b9-5ee1-4a3a-a63a-1b19e5cdb2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.809945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f9b9-5ee1-4a3a-a63a-1b19e5cdb2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.810341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f9b9-5ee1-4a3a-a63a-1b19e5cdb2f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.828195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66f9b9-5ee1-4a3a-a63a-1b19e5cdb2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-1d66f9b9-5ee1-4a3a-a63a-1b19e5cdb2f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:22:58.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:22:58.834249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:22:58.835129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:22:58.837499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 144/285] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:22:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:22:58.847221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f9b9-5ee1-4a3a-a63a-1b19e5cdb2f4 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:58.883858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a3995-e514-4fdf-be76-36c747ded3b8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:58.931445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:58.932435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:58.932971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:58.933519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:58.934429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:58.934964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:58.936576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:58.948520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:58.954000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 142/286] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:58.967576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:59.098501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f9b9-5ee1-4a3a-a63a-1b19e5cdb2f4 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:59.202371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:59.206487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:59.206487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:59.206487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:59.206487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:59.206813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:22:59.206813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:59.206813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:59.228751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668da18-f85d-4427-9f7b-ca1c7e6f0b43 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:59.231763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 145/287] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:22:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:59.239592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:59.313629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d401-7bc9-4619-a104-da22557db6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:59.314267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d401-7bc9-4619-a104-da22557db6ab None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:59.314575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d401-7bc9-4619-a104-da22557db6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:59.314850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d401-7bc9-4619-a104-da22557db6ab None admin] PATH_INFO: `/v3/users/ef404394d55745d1979a25f4724bb238` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:59.317859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4d401-7bc9-4619-a104-da22557db6ab None admin] RBAC: Authorizing `identity:get_user(user_id=ef404394d55745d1979a25f4724bb238)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:59.320131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4d401-7bc9-4619-a104-da22557db6ab None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:59.322504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 143/288] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:58 2022] GET /identity/v3/users/ef404394d55745d1979a25f4724bb238 => generated 297 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:59.327056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d401-7bc9-4619-a104-da22557db6ab None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:59.446232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b490a8-bd55-4ebc-9fbc-c180c904bf61 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:59.462897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:59.468718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d401-7bc9-4619-a104-da22557db6ab None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:59.502167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6ac9-4fb4-4790-be02-5bece12e1b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:59.502934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6ac9-4fb4-4790-be02-5bece12e1b2a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:59.503217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6ac9-4fb4-4790-be02-5bece12e1b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:59.503481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6ac9-4fb4-4790-be02-5bece12e1b2a None admin] PATH_INFO: `/v3/users/1079c7cb0eb94eadb8d21497c3f0d3c2` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:59.507355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6ac9-4fb4-4790-be02-5bece12e1b2a None admin] RBAC: Authorizing `identity:get_user(user_id=1079c7cb0eb94eadb8d21497c3f0d3c2)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:59.509049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6ac9-4fb4-4790-be02-5bece12e1b2a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:59.509436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0d206-1d34-4dea-84d1-ebc54634ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:59.510039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0d206-1d34-4dea-84d1-ebc54634ad66 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:59.510339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0d206-1d34-4dea-84d1-ebc54634ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:59.510642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0d206-1d34-4dea-84d1-ebc54634ad66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:59.510743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 146/289] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:22:59 2022] GET /identity/v3/users/1079c7cb0eb94eadb8d21497c3f0d3c2 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:59.524726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6ac9-4fb4-4790-be02-5bece12e1b2a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:59.555740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:59.584577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0d206-1d34-4dea-84d1-ebc54634ad66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:59.586124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0d206-1d34-4dea-84d1-ebc54634ad66 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:59.697529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 144/290] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:22:59.703713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0d206-1d34-4dea-84d1-ebc54634ad66 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:59.719352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6ac9-4fb4-4790-be02-5bece12e1b2a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:59.778830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:22:59.809509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0d206-1d34-4dea-84d1-ebc54634ad66 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:22:59.848315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515ea2-6220-4142-aa83-087094afa21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:59.848995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515ea2-6220-4142-aa83-087094afa21a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:59.849240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515ea2-6220-4142-aa83-087094afa21a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:59.849511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515ea2-6220-4142-aa83-087094afa21a None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:59.850741 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86515ea2-6220-4142-aa83-087094afa21a None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:59.852233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86515ea2-6220-4142-aa83-087094afa21a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:59.854359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 147/291] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:59 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:59.856357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09496b-bf79-4e96-b768-b3ba9d992a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:22:59.857129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09496b-bf79-4e96-b768-b3ba9d992a38 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:22:59.857529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09496b-bf79-4e96-b768-b3ba9d992a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:22:59.857901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09496b-bf79-4e96-b768-b3ba9d992a38 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:22:59.859306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09496b-bf79-4e96-b768-b3ba9d992a38 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:22:59.860670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515ea2-6220-4142-aa83-087094afa21a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:59.865056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09496b-bf79-4e96-b768-b3ba9d992a38 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:22:59.866883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 145/292] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:22:59 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:22:59.873620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09496b-bf79-4e96-b768-b3ba9d992a38 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:22:59.924606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:00.034272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515ea2-6220-4142-aa83-087094afa21a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:00.053155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09496b-bf79-4e96-b768-b3ba9d992a38 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:00.093142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43178c-2d41-4fd9-b054-06d6b7c31eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:00.093796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43178c-2d41-4fd9-b054-06d6b7c31eda None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:00.094077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43178c-2d41-4fd9-b054-06d6b7c31eda None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:00.094345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43178c-2d41-4fd9-b054-06d6b7c31eda None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c/users/1079c7cb0eb94eadb8d21497c3f0d3c2/roles/09d6cbb5feda48f389570c916edfda07` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:00.097385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43178c-2d41-4fd9-b054-06d6b7c31eda None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d1fb582804a18bbe932f7917df50c, user_id=1079c7cb0eb94eadb8d21497c3f0d3c2, role_id=09d6cbb5feda48f389570c916edfda07)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:00.098854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43178c-2d41-4fd9-b054-06d6b7c31eda None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:00.110613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b82aca-80b7-4046-b69d-36008e11b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:00.111240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82aca-80b7-4046-b69d-36008e11b20c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:00.122649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82aca-80b7-4046-b69d-36008e11b20c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:00.122649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82aca-80b7-4046-b69d-36008e11b20c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:00.122649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b82aca-80b7-4046-b69d-36008e11b20c None admin] RBAC: Adding query filter params (role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=ee1d1fb582804a18bbe932f7917df50c, user.id=ef404394d55745d1979a25f4724bb238) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:00.122649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b82aca-80b7-4046-b69d-36008e11b20c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:00.122649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b82aca-80b7-4046-b69d-36008e11b20c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:00.123006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 146/293] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:22:59 2022] GET /identity/v3/role_assignments?user.id=ef404394d55745d1979a25f4724bb238&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=4851e677104948daa4c8bcf195bd8608 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:00.123006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:00.184566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 148/294] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:22:59 2022] PUT /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c/users/1079c7cb0eb94eadb8d21497c3f0d3c2/roles/09d6cbb5feda48f389570c916edfda07 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:00.775866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769c6d8-eae1-4482-87a3-4af412c62dbf None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:00.776148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769c6d8-eae1-4482-87a3-4af412c62dbf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:00.776680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769c6d8-eae1-4482-87a3-4af412c62dbf None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:00.778260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 147/295] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:00.783567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea9933-aa34-46c9-b81b-48f3f382d5c5 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:00.784084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea9933-aa34-46c9-b81b-48f3f382d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:00.784555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea9933-aa34-46c9-b81b-48f3f382d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:00.803432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-85ea9933-aa34-46c9-b81b-48f3f382d5c5 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:00.804944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-85ea9933-aa34-46c9-b81b-48f3f382d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:00.808416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124a4e5-927f-4d50-9651-54f01956e8ed None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:00.808699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124a4e5-927f-4d50-9651-54f01956e8ed None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:00.808972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124a4e5-927f-4d50-9651-54f01956e8ed None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:00.810303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 148/296] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:23:00.816531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55b3d7-351c-449a-921a-0fe06636e5c3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:00.816817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55b3d7-351c-449a-921a-0fe06636e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:00.817093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55b3d7-351c-449a-921a-0fe06636e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:00.835288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2e55b3d7-351c-449a-921a-0fe06636e5c3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:00.836791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2e55b3d7-351c-449a-921a-0fe06636e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:00.882179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 149/297] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:00.905169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea9933-aa34-46c9-b81b-48f3f382d5c5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:00.906872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 149/298] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:00.929917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55b3d7-351c-449a-921a-0fe06636e5c3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:00.932280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:01.013299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea9933-aa34-46c9-b81b-48f3f382d5c5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.031793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55b3d7-351c-449a-921a-0fe06636e5c3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.050507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e6d10-764e-4b17-88be-c72956b1648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.051373 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e6d10-764e-4b17-88be-c72956b1648b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.051794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e6d10-764e-4b17-88be-c72956b1648b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.052231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e6d10-764e-4b17-88be-c72956b1648b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.063116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e6d10-764e-4b17-88be-c72956b1648b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:01.066772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3817-7695-4170-9f15-72f1d24c0290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.067478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3817-7695-4170-9f15-72f1d24c0290 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.067824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3817-7695-4170-9f15-72f1d24c0290 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.068164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3817-7695-4170-9f15-72f1d24c0290 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-a94e6d10-764e-4b17-88be-c72956b1648b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:01.069328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:01.070376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:01.071611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:01.078367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 150/299] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:01.078524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:01.079233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e6d10-764e-4b17-88be-c72956b1648b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:01.081560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f3817-7695-4170-9f15-72f1d24c0290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-365f3817-7695-4170-9f15-72f1d24c0290 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:01.086489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:01.094042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:01.094869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 150/300] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:01.097065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3817-7695-4170-9f15-72f1d24c0290 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:01.167391 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:01.184447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e6d10-764e-4b17-88be-c72956b1648b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.199450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3817-7695-4170-9f15-72f1d24c0290 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.220001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.220661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.220941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.221210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.221876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:01.222177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:01.223594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:01.237339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 151/301] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:01.238223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:01.241172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.242126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.242662 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.243132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.243968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:01.244443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:01.246706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:01.260745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 151/302] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:01.262072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:01.316916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:01.337836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4da802-9d87-45a8-87fe-84a4c2ac0cf7 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.370922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac184a-140b-4f91-94ce-27a1cb61556e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.374720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554d9cc-0cee-431f-a1be-223ffaab9e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.375678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554d9cc-0cee-431f-a1be-223ffaab9e83 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.376160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554d9cc-0cee-431f-a1be-223ffaab9e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.376643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554d9cc-0cee-431f-a1be-223ffaab9e83 None admin] PATH_INFO: `/v3/users/f155904873ba4c5499b451856296a715` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.377912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554d9cc-0cee-431f-a1be-223ffaab9e83 None admin] RBAC: Authorizing `identity:get_user(user_id=f155904873ba4c5499b451856296a715)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:01.379379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554d9cc-0cee-431f-a1be-223ffaab9e83 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:01.385891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 152/303] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:23:01 2022] GET /identity/v3/users/f155904873ba4c5499b451856296a715 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:01.385891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d150e-7c84-4f44-a16b-4297e55cf152 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.385891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d150e-7c84-4f44-a16b-4297e55cf152 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.385891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d150e-7c84-4f44-a16b-4297e55cf152 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.385891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 153/304] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:01.387278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d150e-7c84-4f44-a16b-4297e55cf152 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:01.406767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:01.414668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6150581-3d42-4bcc-8ef3-3ac0efc2beab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.415414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150581-3d42-4bcc-8ef3-3ac0efc2beab None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.415874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150581-3d42-4bcc-8ef3-3ac0efc2beab None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.415981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150581-3d42-4bcc-8ef3-3ac0efc2beab None admin] PATH_INFO: `/v3/users/bdd708d1896941e2bbb6efa5f338e874` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.435206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6150581-3d42-4bcc-8ef3-3ac0efc2beab None admin] RBAC: Authorizing `identity:get_user(user_id=bdd708d1896941e2bbb6efa5f338e874)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:01.437089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6150581-3d42-4bcc-8ef3-3ac0efc2beab None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:01.444285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 152/305] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:23:01 2022] GET /identity/v3/users/bdd708d1896941e2bbb6efa5f338e874 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:01.444285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0721-a819-4563-95b6-ea162e824ad9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.444285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0721-a819-4563-95b6-ea162e824ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.444285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0721-a819-4563-95b6-ea162e824ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.462929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-08bb0721-a819-4563-95b6-ea162e824ad9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:01.464170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-08bb0721-a819-4563-95b6-ea162e824ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:01.497753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d150e-7c84-4f44-a16b-4297e55cf152 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.533196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 153/306] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:01.533865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0721-a819-4563-95b6-ea162e824ad9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:01.543482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155d0c-ef5f-42ee-9ddd-3dba8c329cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.544876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155d0c-ef5f-42ee-9ddd-3dba8c329cdd None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.545837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155d0c-ef5f-42ee-9ddd-3dba8c329cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.546507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155d0c-ef5f-42ee-9ddd-3dba8c329cdd None admin] PATH_INFO: `/v3/system/users/f155904873ba4c5499b451856296a715/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.548512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68155d0c-ef5f-42ee-9ddd-3dba8c329cdd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f155904873ba4c5499b451856296a715, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:01.550974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68155d0c-ef5f-42ee-9ddd-3dba8c329cdd None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:01.574859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:01.632585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0721-a819-4563-95b6-ea162e824ad9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.649170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 154/307] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Aug 10 08:23:01 2022] PUT /identity/v3/system/users/f155904873ba4c5499b451856296a715/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:01.655621 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155d0c-ef5f-42ee-9ddd-3dba8c329cdd None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:01.669818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.670640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.670919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.671194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.672042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] RBAC: Adding query filter params (role.id=09d6cbb5feda48f389570c916edfda07, user.id=bdd708d1896941e2bbb6efa5f338e874, scope.system=all) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:01.672358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:01.673985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:01.680169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 154/308] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Aug 10 08:23:01 2022] GET /identity/v3/role_assignments?user.id=bdd708d1896941e2bbb6efa5f338e874&scope.system=all&role.id=09d6cbb5feda48f389570c916edfda07 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:01.760033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:01.787564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155d0c-ef5f-42ee-9ddd-3dba8c329cdd None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.828311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008ce0b-4c5f-4901-8110-a40d5f9be0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.829213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ce0b-4c5f-4901-8110-a40d5f9be0ee None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.829645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ce0b-4c5f-4901-8110-a40d5f9be0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.830062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ce0b-4c5f-4901-8110-a40d5f9be0ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.831580 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008ce0b-4c5f-4901-8110-a40d5f9be0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:01.833289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008ce0b-4c5f-4901-8110-a40d5f9be0ee None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:01.835206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 155/309] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:01.842075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:01.959839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a8d6d-607b-40ed-b045-f483c9adce60 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:01.961344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:01.995999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756c98a-c29a-4067-8165-67e3104542dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:01.996612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c98a-c29a-4067-8165-67e3104542dc None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:01.996890 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c98a-c29a-4067-8165-67e3104542dc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:01.997164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c98a-c29a-4067-8165-67e3104542dc None admin] PATH_INFO: `/v3/groups` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:01.997785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756c98a-c29a-4067-8165-67e3104542dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:01.999305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756c98a-c29a-4067-8165-67e3104542dc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:02.084059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 155/310] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Aug 10 08:23:01 2022] POST /identity/v3/groups => generated 229 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:02.348876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390a21-4dbd-40da-a2a5-08f8f099d91b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:02.349360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390a21-4dbd-40da-a2a5-08f8f099d91b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:02.349360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390a21-4dbd-40da-a2a5-08f8f099d91b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:02.351021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 156/311] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:02.356840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08e19d-040b-42f3-85ff-13605596b990 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:02.357131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08e19d-040b-42f3-85ff-13605596b990 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:02.357411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08e19d-040b-42f3-85ff-13605596b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:02.375929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3a08e19d-040b-42f3-85ff-13605596b990 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:02.377117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3a08e19d-040b-42f3-85ff-13605596b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:02.451407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 156/312] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:02.474543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390a21-4dbd-40da-a2a5-08f8f099d91b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:02.584912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390a21-4dbd-40da-a2a5-08f8f099d91b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:02.619639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64e303-7245-4b5c-8075-6dd33bf6f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:02.620478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64e303-7245-4b5c-8075-6dd33bf6f858 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:02.620903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64e303-7245-4b5c-8075-6dd33bf6f858 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:02.621317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64e303-7245-4b5c-8075-6dd33bf6f858 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:02.631784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64e303-7245-4b5c-8075-6dd33bf6f858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-9a64e303-7245-4b5c-8075-6dd33bf6f858 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:02.637503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:02.638611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:23:02.639645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:02.641808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 157/313] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:02.651901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08e19d-040b-42f3-85ff-13605596b990 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:02.745168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:02.753847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08e19d-040b-42f3-85ff-13605596b990 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:02.789608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:02.790228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:02.790600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:02.791032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:02.791731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:02.792035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:02.793417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:02.801808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 157/314] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:02.807468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64e303-7245-4b5c-8075-6dd33bf6f858 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:02.816963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:02.918885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64e303-7245-4b5c-8075-6dd33bf6f858 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:02.954135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f238-bafd-464b-b111-a1837a6ba3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:02.954804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f238-bafd-464b-b111-a1837a6ba3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:02.955082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f238-bafd-464b-b111-a1837a6ba3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:02.955351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f238-bafd-464b-b111-a1837a6ba3a5 None admin] PATH_INFO: `/v3/users/1079c7cb0eb94eadb8d21497c3f0d3c2` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:02.956490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6f238-bafd-464b-b111-a1837a6ba3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=1079c7cb0eb94eadb8d21497c3f0d3c2)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:02.957920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6f238-bafd-464b-b111-a1837a6ba3a5 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:02.959887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 158/315] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:23:02 2022] GET /identity/v3/users/1079c7cb0eb94eadb8d21497c3f0d3c2 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:02.965643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:03.066703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6661f5d-500c-465b-abeb-63fdf11c5f8f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:03.100594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb34ebd-795b-4d1a-8743-6d87ed8094f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:03.101277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb34ebd-795b-4d1a-8743-6d87ed8094f7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:03.101469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb34ebd-795b-4d1a-8743-6d87ed8094f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:03.101739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb34ebd-795b-4d1a-8743-6d87ed8094f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:03.127808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:03.173995 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb34ebd-795b-4d1a-8743-6d87ed8094f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:03.175792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb34ebd-795b-4d1a-8743-6d87ed8094f7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:03.279383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 158/316] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:03.285062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f238-bafd-464b-b111-a1837a6ba3a5 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:03.364223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:03.389205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f238-bafd-464b-b111-a1837a6ba3a5 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:03.425345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7015e-f676-4f07-9db7-cfef9b889f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:03.425898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7015e-f676-4f07-9db7-cfef9b889f1b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:03.426178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7015e-f676-4f07-9db7-cfef9b889f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:03.426448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7015e-f676-4f07-9db7-cfef9b889f1b None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:03.427622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7015e-f676-4f07-9db7-cfef9b889f1b None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:03.429069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7015e-f676-4f07-9db7-cfef9b889f1b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:03.430903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 159/317] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:03 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:03.436873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb34ebd-795b-4d1a-8743-6d87ed8094f7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:03.492404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:03.541327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb34ebd-795b-4d1a-8743-6d87ed8094f7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:03.576392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc7464-3a60-4e8b-b0e2-8cb391b6538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:03.576996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc7464-3a60-4e8b-b0e2-8cb391b6538e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:03.577271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc7464-3a60-4e8b-b0e2-8cb391b6538e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:03.577539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc7464-3a60-4e8b-b0e2-8cb391b6538e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:03.578264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc7464-3a60-4e8b-b0e2-8cb391b6538e None admin] RBAC: Adding query filter params (role.id=09d6cbb5feda48f389570c916edfda07, scope.project.id=ee1d1fb582804a18bbe932f7917df50c, user.id=1079c7cb0eb94eadb8d21497c3f0d3c2) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:03.578596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc7464-3a60-4e8b-b0e2-8cb391b6538e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:03.580023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc7464-3a60-4e8b-b0e2-8cb391b6538e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:03.586258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 159/318] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:03 2022] GET /identity/v3/role_assignments?user.id=1079c7cb0eb94eadb8d21497c3f0d3c2&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=09d6cbb5feda48f389570c916edfda07 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:03.734053 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93783e6-e190-49b2-bc0a-6e86964089d3 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:03.734241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93783e6-e190-49b2-bc0a-6e86964089d3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:03.734529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93783e6-e190-49b2-bc0a-6e86964089d3 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:03.736389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 160/319] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:03.741526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13e4ba-f845-493e-819b-465ffad7d75e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:03.741808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13e4ba-f845-493e-819b-465ffad7d75e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:03.742083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13e4ba-f845-493e-819b-465ffad7d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:03.761275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9c13e4ba-f845-493e-819b-465ffad7d75e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:03.762895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9c13e4ba-f845-493e-819b-465ffad7d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:03.838620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 160/320] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:03.860182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93783e6-e190-49b2-bc0a-6e86964089d3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:03.879412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e790f0-ca97-4366-b50f-754e565d2e32 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:03.879695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e790f0-ca97-4366-b50f-754e565d2e32 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:03.879974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e790f0-ca97-4366-b50f-754e565d2e32 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:03.881465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 161/321] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:23:03.886617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d89b2-b87f-41fe-b7d9-f5948dfbaaf1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:03.886893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d89b2-b87f-41fe-b7d9-f5948dfbaaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:03.887164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d89b2-b87f-41fe-b7d9-f5948dfbaaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:03.907383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-105d89b2-b87f-41fe-b7d9-f5948dfbaaf1 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:03.908695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-105d89b2-b87f-41fe-b7d9-f5948dfbaaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:03.957929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:03.975946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93783e6-e190-49b2-bc0a-6e86964089d3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:03.981085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 162/322] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:04.004993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d89b2-b87f-41fe-b7d9-f5948dfbaaf1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.017879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86751-8858-45d1-afb2-8c138e3ea7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.018534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86751-8858-45d1-afb2-8c138e3ea7cc None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.018817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86751-8858-45d1-afb2-8c138e3ea7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.019120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86751-8858-45d1-afb2-8c138e3ea7cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.030086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b86751-8858-45d1-afb2-8c138e3ea7cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-d2b86751-8858-45d1-afb2-8c138e3ea7cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:04.035216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:04.036104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:04.036914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 161/323] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:04.041940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86751-8858-45d1-afb2-8c138e3ea7cc None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.044822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:04.110596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d89b2-b87f-41fe-b7d9-f5948dfbaaf1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.146615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86751-8858-45d1-afb2-8c138e3ea7cc None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.148510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67a10f-ceb1-4660-bf43-f4d0fbc93be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.149152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67a10f-ceb1-4660-bf43-f4d0fbc93be8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.149427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67a10f-ceb1-4660-bf43-f4d0fbc93be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.149695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67a10f-ceb1-4660-bf43-f4d0fbc93be8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.160369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67a10f-ceb1-4660-bf43-f4d0fbc93be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ed67a10f-ceb1-4660-bf43-f4d0fbc93be8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:04.165217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:04.166096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:04.167022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 163/324] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:04.173606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67a10f-ceb1-4660-bf43-f4d0fbc93be8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.187361 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.188011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.188259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.188530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.189216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:04.189571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.190990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.200036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 162/325] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:04.205368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.221300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:04.267429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:04.279330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67a10f-ceb1-4660-bf43-f4d0fbc93be8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.304463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f101de9-ddc4-4ea6-87a9-6ab436f6f24a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.313499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9403-b4a3-4b11-abcf-1b8f263cc5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.314102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9403-b4a3-4b11-abcf-1b8f263cc5fc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.314375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9403-b4a3-4b11-abcf-1b8f263cc5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.314669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9403-b4a3-4b11-abcf-1b8f263cc5fc None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.315329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9403-b4a3-4b11-abcf-1b8f263cc5fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:04.315627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9403-b4a3-4b11-abcf-1b8f263cc5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.316986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9403-b4a3-4b11-abcf-1b8f263cc5fc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.325494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 164/326] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:04.326798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f344b-3731-48c0-ad3a-4327d8fdfbef None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.327082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f344b-3731-48c0-ad3a-4327d8fdfbef None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.327352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f344b-3731-48c0-ad3a-4327d8fdfbef None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.328841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 165/327] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:04.331126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f344b-3731-48c0-ad3a-4327d8fdfbef None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.340227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce9215-8ed8-48d5-8efb-a887726549d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.340850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce9215-8ed8-48d5-8efb-a887726549d3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.341121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce9215-8ed8-48d5-8efb-a887726549d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.341384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce9215-8ed8-48d5-8efb-a887726549d3 None admin] PATH_INFO: `/v3/users/bdd708d1896941e2bbb6efa5f338e874` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.342529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce9215-8ed8-48d5-8efb-a887726549d3 None admin] RBAC: Authorizing `identity:get_user(user_id=bdd708d1896941e2bbb6efa5f338e874)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.343959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce9215-8ed8-48d5-8efb-a887726549d3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.345499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 163/328] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:23:04 2022] GET /identity/v3/users/bdd708d1896941e2bbb6efa5f338e874 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:04.346592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497faa02-238c-4ce1-a16f-b75f912dd97b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.346868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497faa02-238c-4ce1-a16f-b75f912dd97b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.347136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497faa02-238c-4ce1-a16f-b75f912dd97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.364508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-497faa02-238c-4ce1-a16f-b75f912dd97b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:04.365687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-497faa02-238c-4ce1-a16f-b75f912dd97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:04.428750 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:04.430905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 164/329] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:04.431858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497faa02-238c-4ce1-a16f-b75f912dd97b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.432954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f344b-3731-48c0-ad3a-4327d8fdfbef None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.469208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14805-3313-4dd6-9cef-7847c3cb7bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.469832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14805-3313-4dd6-9cef-7847c3cb7bac None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.470105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14805-3313-4dd6-9cef-7847c3cb7bac None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.470373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14805-3313-4dd6-9cef-7847c3cb7bac None admin] PATH_INFO: `/v3/users/f155904873ba4c5499b451856296a715` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.471524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab14805-3313-4dd6-9cef-7847c3cb7bac None admin] RBAC: Authorizing `identity:get_user(user_id=f155904873ba4c5499b451856296a715)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.472945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab14805-3313-4dd6-9cef-7847c3cb7bac None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.474660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 166/330] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:23:04 2022] GET /identity/v3/users/f155904873ba4c5499b451856296a715 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:04.475265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14805-3313-4dd6-9cef-7847c3cb7bac None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.492650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:04.530019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497faa02-238c-4ce1-a16f-b75f912dd97b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.563882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51548fe-c233-4a69-8680-eb04024c8a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.564517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51548fe-c233-4a69-8680-eb04024c8a0b None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.564795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51548fe-c233-4a69-8680-eb04024c8a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.565061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51548fe-c233-4a69-8680-eb04024c8a0b None admin] PATH_INFO: `/v3/system/users/bdd708d1896941e2bbb6efa5f338e874/roles/09d6cbb5feda48f389570c916edfda07` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.566457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51548fe-c233-4a69-8680-eb04024c8a0b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bdd708d1896941e2bbb6efa5f338e874, role_id=09d6cbb5feda48f389570c916edfda07)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.567845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51548fe-c233-4a69-8680-eb04024c8a0b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.573197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14805-3313-4dd6-9cef-7847c3cb7bac None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.606666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073adc9c-2f9a-4d57-802a-e6b97405cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.607280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073adc9c-2f9a-4d57-802a-e6b97405cdbe None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.607603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073adc9c-2f9a-4d57-802a-e6b97405cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.607871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073adc9c-2f9a-4d57-802a-e6b97405cdbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.608942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073adc9c-2f9a-4d57-802a-e6b97405cdbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.610365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073adc9c-2f9a-4d57-802a-e6b97405cdbe None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.611934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 167/331] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:04.612675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073adc9c-2f9a-4d57-802a-e6b97405cdbe None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.631774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 165/332] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Aug 10 08:23:04 2022] PUT /identity/v3/system/users/bdd708d1896941e2bbb6efa5f338e874/roles/09d6cbb5feda48f389570c916edfda07 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:04.636113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51548fe-c233-4a69-8680-eb04024c8a0b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:04.663140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:04.738675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073adc9c-2f9a-4d57-802a-e6b97405cdbe None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.741812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51548fe-c233-4a69-8680-eb04024c8a0b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:04.768514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:04.777619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14ea73-1c1b-475e-bd09-f739fe7d2534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.777890 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa8996-9e8d-4861-9f84-ebd25992a9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:04.778225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ea73-1c1b-475e-bd09-f739fe7d2534 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.778517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ea73-1c1b-475e-bd09-f739fe7d2534 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.778784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ea73-1c1b-475e-bd09-f739fe7d2534 None admin] PATH_INFO: `/v3/groups` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.779144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8996-9e8d-4861-9f84-ebd25992a9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:04.779405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14ea73-1c1b-475e-bd09-f739fe7d2534 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.779507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8996-9e8d-4861-9f84-ebd25992a9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:04.779727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8996-9e8d-4861-9f84-ebd25992a9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:04.780571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa8996-9e8d-4861-9f84-ebd25992a9a4 None admin] RBAC: Adding query filter params (role.id=4851e677104948daa4c8bcf195bd8608, user.id=f155904873ba4c5499b451856296a715, scope.system=all) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:04.780820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa8996-9e8d-4861-9f84-ebd25992a9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:04.780904 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14ea73-1c1b-475e-bd09-f739fe7d2534 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.782295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa8996-9e8d-4861-9f84-ebd25992a9a4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:04.796127 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 168/333] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Aug 10 08:23:04 2022] GET /identity/v3/role_assignments?user.id=f155904873ba4c5499b451856296a715&scope.system=all&role.id=4851e677104948daa4c8bcf195bd8608 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:04.905849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 166/334] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Aug 10 08:23:04 2022] POST /identity/v3/groups => generated 226 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:06.723748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56680e0-aefe-4058-b800-ad2f2635e022 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:06.724270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56680e0-aefe-4058-b800-ad2f2635e022 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:06.724270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56680e0-aefe-4058-b800-ad2f2635e022 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:06.725858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 169/335] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:06.732005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f816-3a53-414d-88a4-2581842f0127 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:06.732447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f816-3a53-414d-88a4-2581842f0127 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:06.732522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f816-3a53-414d-88a4-2581842f0127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:06.760450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1549f816-3a53-414d-88a4-2581842f0127 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:06.761680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1549f816-3a53-414d-88a4-2581842f0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:06.855129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 167/336] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:06.893793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56680e0-aefe-4058-b800-ad2f2635e022 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:07.017980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:07.025361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56680e0-aefe-4058-b800-ad2f2635e022 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:07.068270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737b0ce-3124-480b-8272-4a9988daa492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:07.068909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b0ce-3124-480b-8272-4a9988daa492 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.069184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b0ce-3124-480b-8272-4a9988daa492 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.069450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b0ce-3124-480b-8272-4a9988daa492 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.084203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737b0ce-3124-480b-8272-4a9988daa492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9737b0ce-3124-480b-8272-4a9988daa492 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:07.088934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:07.090939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:07.091738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 170/337] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:07.098489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f816-3a53-414d-88a4-2581842f0127 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:07.217992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f816-3a53-414d-88a4-2581842f0127 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:07.237577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:07.265624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:07.266240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.266538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.266807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.267486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:07.267790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:07.269656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:07.278348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 168/338] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:07.284017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737b0ce-3124-480b-8272-4a9988daa492 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:07.434204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737b0ce-3124-480b-8272-4a9988daa492 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:07.481655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c327e-58db-499f-8f13-5c7ad4f9679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:07.482298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c327e-58db-499f-8f13-5c7ad4f9679a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.482608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c327e-58db-499f-8f13-5c7ad4f9679a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.482882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c327e-58db-499f-8f13-5c7ad4f9679a None admin] PATH_INFO: `/v3/users/bdd708d1896941e2bbb6efa5f338e874` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.484198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c327e-58db-499f-8f13-5c7ad4f9679a None admin] RBAC: Authorizing `identity:get_user(user_id=bdd708d1896941e2bbb6efa5f338e874)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:07.485674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c327e-58db-499f-8f13-5c7ad4f9679a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:07.487695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 171/339] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:23:07 2022] GET /identity/v3/users/bdd708d1896941e2bbb6efa5f338e874 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:07.493586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:07.499388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3cbbd-b850-436e-802d-93c27be97eb7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.499672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3cbbd-b850-436e-802d-93c27be97eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.499944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3cbbd-b850-436e-802d-93c27be97eb7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.501549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 172/340] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:07.510254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4deb7f-5666-4f43-8f8c-60bffe664319 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.510254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4deb7f-5666-4f43-8f8c-60bffe664319 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.510254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4deb7f-5666-4f43-8f8c-60bffe664319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.526829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1d4deb7f-5666-4f43-8f8c-60bffe664319 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:07.528049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1d4deb7f-5666-4f43-8f8c-60bffe664319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:07.549735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:07.664120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 173/341] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:07.665422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541dfb2-6a42-497d-b007-b1d3b32c70e1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.665703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541dfb2-6a42-497d-b007-b1d3b32c70e1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.665973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541dfb2-6a42-497d-b007-b1d3b32c70e1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.668026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 174/342] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:07.673090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665bde-02a7-4f99-9d56-1352e092155d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.673369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665bde-02a7-4f99-9d56-1352e092155d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.673642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665bde-02a7-4f99-9d56-1352e092155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.681933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4acff-eabb-4409-b03d-b82e038b509f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:07.715653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e5665bde-02a7-4f99-9d56-1352e092155d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:07.716879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e5665bde-02a7-4f99-9d56-1352e092155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:07.745367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:07.746049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.746313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.746619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.747613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] RBAC: Adding query filter params (role.id=09d6cbb5feda48f389570c916edfda07, user.id=bdd708d1896941e2bbb6efa5f338e874, scope.system=all) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:07.748540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:07.750232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:07.774933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 169/343] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Aug 10 08:23:07 2022] GET /identity/v3/role_assignments?user.id=bdd708d1896941e2bbb6efa5f338e874&scope.system=all&role.id=09d6cbb5feda48f389570c916edfda07 => generated 510 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:07.776621 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:07.822317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:07.902216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9145cf2-096b-4a75-9b1e-0f28397749e7 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:07.941474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9e81a-bed3-45f5-b891-85db3401fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:07.942183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9e81a-bed3-45f5-b891-85db3401fa2d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:07.942549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9e81a-bed3-45f5-b891-85db3401fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:07.942820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9e81a-bed3-45f5-b891-85db3401fa2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:07.953066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 175/344] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:07.956297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9e81a-bed3-45f5-b891-85db3401fa2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-3af9e81a-bed3-45f5-b891-85db3401fa2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:07.961721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:07.962788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:07.964410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:07.965141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 170/345] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:07.970069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665bde-02a7-4f99-9d56-1352e092155d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:08.002695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9e81a-bed3-45f5-b891-85db3401fa2d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:08.127236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9e81a-bed3-45f5-b891-85db3401fa2d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:08.130814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:08.143231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:08.165514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665bde-02a7-4f99-9d56-1352e092155d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:08.172987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173899fe-ea0e-4e00-b477-cdea42d587e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:08.173639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173899fe-ea0e-4e00-b477-cdea42d587e0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.173898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173899fe-ea0e-4e00-b477-cdea42d587e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.174169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173899fe-ea0e-4e00-b477-cdea42d587e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.186855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173899fe-ea0e-4e00-b477-cdea42d587e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-173899fe-ea0e-4e00-b477-cdea42d587e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:08.192011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:08.193188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:08.194195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:08.196821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 171/346] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:23:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:08.202724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173899fe-ea0e-4e00-b477-cdea42d587e0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:08.236142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909583e0-79a7-44b0-82b0-3cf71b76d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:08.236939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909583e0-79a7-44b0-82b0-3cf71b76d7da None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.237323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909583e0-79a7-44b0-82b0-3cf71b76d7da None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.237718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909583e0-79a7-44b0-82b0-3cf71b76d7da None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.238525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909583e0-79a7-44b0-82b0-3cf71b76d7da None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:08.238938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909583e0-79a7-44b0-82b0-3cf71b76d7da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:08.240420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909583e0-79a7-44b0-82b0-3cf71b76d7da None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:08.253983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 176/347] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:08.260860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32eabf-9c52-4baa-ad40-398e7383b660 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.261269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32eabf-9c52-4baa-ad40-398e7383b660 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.261639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32eabf-9c52-4baa-ad40-398e7383b660 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.263356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 177/348] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:08.266117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32eabf-9c52-4baa-ad40-398e7383b660 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:08.319019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173899fe-ea0e-4e00-b477-cdea42d587e0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:08.357461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de2257-51a0-4c88-8102-d886a1df90de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:08.358340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de2257-51a0-4c88-8102-d886a1df90de None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.358800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de2257-51a0-4c88-8102-d886a1df90de None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.359215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de2257-51a0-4c88-8102-d886a1df90de None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.360078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de2257-51a0-4c88-8102-d886a1df90de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:08.360545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de2257-51a0-4c88-8102-d886a1df90de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:08.362141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de2257-51a0-4c88-8102-d886a1df90de None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:08.371993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 172/349] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:08.373598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c798ef-3de0-430a-afa3-24b5f1f8a8f3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c798ef-3de0-430a-afa3-24b5f1f8a8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.374533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c798ef-3de0-430a-afa3-24b5f1f8a8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.390516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32eabf-9c52-4baa-ad40-398e7383b660 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:08.396990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-35c798ef-3de0-430a-afa3-24b5f1f8a8f3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:08.398497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-35c798ef-3de0-430a-afa3-24b5f1f8a8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:08.417974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:08.434039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3d7ee-229b-48c3-bef7-1dbea84a90e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:08.434620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3d7ee-229b-48c3-bef7-1dbea84a90e8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.434951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3d7ee-229b-48c3-bef7-1dbea84a90e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.435223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3d7ee-229b-48c3-bef7-1dbea84a90e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.451968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:08.480517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 173/350] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:08.482669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c798ef-3de0-430a-afa3-24b5f1f8a8f3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:08.510752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3d7ee-229b-48c3-bef7-1dbea84a90e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:08.512289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3d7ee-229b-48c3-bef7-1dbea84a90e8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:08.588911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c798ef-3de0-430a-afa3-24b5f1f8a8f3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:08.618770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 178/351] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:23:08.619623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3d7ee-229b-48c3-bef7-1dbea84a90e8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:08.631553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9e31e-0a06-40e2-a041-7b13af859cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:08.632491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e31e-0a06-40e2-a041-7b13af859cda None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.632973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e31e-0a06-40e2-a041-7b13af859cda None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.633443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e31e-0a06-40e2-a041-7b13af859cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.654049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:08.673686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:08.710080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9e31e-0a06-40e2-a041-7b13af859cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:08.711778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9e31e-0a06-40e2-a041-7b13af859cda None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:08.731689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3d7ee-229b-48c3-bef7-1dbea84a90e8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:08.770091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ad53-4fab-4eba-a524-f457488811ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:08.771025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ad53-4fab-4eba-a524-f457488811ee None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.771437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ad53-4fab-4eba-a524-f457488811ee None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.771851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ad53-4fab-4eba-a524-f457488811ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.783292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801ad53-4fab-4eba-a524-f457488811ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d801ad53-4fab-4eba-a524-f457488811ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:08.788767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:08.789817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:08.790720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:08.792620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 179/352] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:08.793546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ad53-4fab-4eba-a524-f457488811ee None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:08.832568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 174/353] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:08.833591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9e31e-0a06-40e2-a041-7b13af859cda None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:08.890737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:08.908067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ad53-4fab-4eba-a524-f457488811ee None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:08.910885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:08.963826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4500a4f-55b4-4f21-903f-bfdcdf6c8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:08.963826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500a4f-55b4-4f21-903f-bfdcdf6c8911 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:08.964512 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500a4f-55b4-4f21-903f-bfdcdf6c8911 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:08.964512 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500a4f-55b4-4f21-903f-bfdcdf6c8911 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:08.965748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4500a4f-55b4-4f21-903f-bfdcdf6c8911 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:08.967239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4500a4f-55b4-4f21-903f-bfdcdf6c8911 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:08.967490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9e31e-0a06-40e2-a041-7b13af859cda None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:08.969786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 180/354] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:08 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:08.970341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4500a4f-55b4-4f21-903f-bfdcdf6c8911 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:09.022578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624fdbb-9172-449e-b4e3-07345e2d886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.023299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fdbb-9172-449e-b4e3-07345e2d886e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.023575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fdbb-9172-449e-b4e3-07345e2d886e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.023839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fdbb-9172-449e-b4e3-07345e2d886e None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.024507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fdbb-9172-449e-b4e3-07345e2d886e None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:09.024805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fdbb-9172-449e-b4e3-07345e2d886e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:09.026338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fdbb-9172-449e-b4e3-07345e2d886e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:09.038266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 175/355] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:09.039309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1702-02a6-4d0c-bcc8-b789e7da377b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.039587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1702-02a6-4d0c-bcc8-b789e7da377b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.039861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1702-02a6-4d0c-bcc8-b789e7da377b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.041750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 176/356] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:09.042264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f1702-02a6-4d0c-bcc8-b789e7da377b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:09.121628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4500a4f-55b4-4f21-903f-bfdcdf6c8911 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:09.174385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cc6f-5e0b-4b1e-8a0b-41206829379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.175160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cc6f-5e0b-4b1e-8a0b-41206829379b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.175438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cc6f-5e0b-4b1e-8a0b-41206829379b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.175946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cc6f-5e0b-4b1e-8a0b-41206829379b None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.178443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1cc6f-5e0b-4b1e-8a0b-41206829379b None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:09.179460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1cc6f-5e0b-4b1e-8a0b-41206829379b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:09.180837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f1702-02a6-4d0c-bcc8-b789e7da377b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:09.181095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 181/357] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:08 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:09.181895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cc6f-5e0b-4b1e-8a0b-41206829379b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:09.198881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:09.231089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545541c-5f23-4916-8c0c-44680fcaa9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.232076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545541c-5f23-4916-8c0c-44680fcaa9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.232570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545541c-5f23-4916-8c0c-44680fcaa9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.232847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545541c-5f23-4916-8c0c-44680fcaa9a3 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.236483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:09.240849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545541c-5f23-4916-8c0c-44680fcaa9a3 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:09.242336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545541c-5f23-4916-8c0c-44680fcaa9a3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:09.244303 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 177/358] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:09 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:09.247746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df56f-d548-488b-bbc7-342c354158f9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.248581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df56f-d548-488b-bbc7-342c354158f9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.257326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df56f-d548-488b-bbc7-342c354158f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.271089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ea2df56f-d548-488b-bbc7-342c354158f9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:09.272623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ea2df56f-d548-488b-bbc7-342c354158f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:09.305071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cc6f-5e0b-4b1e-8a0b-41206829379b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:09.343771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcdc69-eb5d-46a3-9a09-5b6304241808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.344138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcdc69-eb5d-46a3-9a09-5b6304241808 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.344393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcdc69-eb5d-46a3-9a09-5b6304241808 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.344664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcdc69-eb5d-46a3-9a09-5b6304241808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.356114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 178/359] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:09.356762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df56f-d548-488b-bbc7-342c354158f9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:09.428506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcdc69-eb5d-46a3-9a09-5b6304241808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:09.430031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcdc69-eb5d-46a3-9a09-5b6304241808 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:09.472431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df56f-d548-488b-bbc7-342c354158f9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:09.474877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:09.476888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:09.511450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568037-dd2e-40ea-bd08-a1be9beabf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.512099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568037-dd2e-40ea-bd08-a1be9beabf29 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.512536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568037-dd2e-40ea-bd08-a1be9beabf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.513110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568037-dd2e-40ea-bd08-a1be9beabf29 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.514347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80568037-dd2e-40ea-bd08-a1be9beabf29 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:09.515855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80568037-dd2e-40ea-bd08-a1be9beabf29 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:09.522687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 179/360] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:09 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:09.522687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568037-dd2e-40ea-bd08-a1be9beabf29 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:09.551180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 182/361] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:09.552290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcdc69-eb5d-46a3-9a09-5b6304241808 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:09.636566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568037-dd2e-40ea-bd08-a1be9beabf29 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:09.675884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcdc69-eb5d-46a3-9a09-5b6304241808 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:09.679585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42074e-e7a7-4c92-9644-47a510266b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.680136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42074e-e7a7-4c92-9644-47a510266b73 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.680409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42074e-e7a7-4c92-9644-47a510266b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.680675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42074e-e7a7-4c92-9644-47a510266b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.681404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42074e-e7a7-4c92-9644-47a510266b73 None admin] RBAC: Adding query filter params (group.id=cb2810fb8ac240bb973ba5e72ae423c9, role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=33df3de83e2f4538b39277107129f1fb) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:09.681705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42074e-e7a7-4c92-9644-47a510266b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:09.683182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42074e-e7a7-4c92-9644-47a510266b73 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:09.689461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 180/362] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:09 2022] GET /identity/v3/role_assignments?group.id=cb2810fb8ac240bb973ba5e72ae423c9&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=4851e677104948daa4c8bcf195bd8608 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:09.690678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71908c-89c5-4365-a0be-edce006caebe None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.690958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71908c-89c5-4365-a0be-edce006caebe None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.691229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71908c-89c5-4365-a0be-edce006caebe None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.692609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 181/363] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:09.693172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71908c-89c5-4365-a0be-edce006caebe None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:09.727137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58942e4-3236-4476-970d-49d6ae24eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.727789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58942e4-3236-4476-970d-49d6ae24eba5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.728135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58942e4-3236-4476-970d-49d6ae24eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.728328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58942e4-3236-4476-970d-49d6ae24eba5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.739602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:09.745028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58942e4-3236-4476-970d-49d6ae24eba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a58942e4-3236-4476-970d-49d6ae24eba5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:09.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:09.757208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 183/364] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:23:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:09.758015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58942e4-3236-4476-970d-49d6ae24eba5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:09.761714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:09.860201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71908c-89c5-4365-a0be-edce006caebe None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:09.890766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58942e4-3236-4476-970d-49d6ae24eba5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:09.899243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58a5f-7d87-4980-9243-40a0596aeb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.899849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58a5f-7d87-4980-9243-40a0596aeb44 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.900416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58a5f-7d87-4980-9243-40a0596aeb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.900416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58a5f-7d87-4980-9243-40a0596aeb44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.901641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58a5f-7d87-4980-9243-40a0596aeb44 None admin] RBAC: Adding query filter params (group.id=cb2810fb8ac240bb973ba5e72ae423c9, role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=33df3de83e2f4538b39277107129f1fb) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:09.901948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58a5f-7d87-4980-9243-40a0596aeb44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:09.903415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58a5f-7d87-4980-9243-40a0596aeb44 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:09.909366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 182/365] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:09 2022] GET /identity/v3/role_assignments?group.id=cb2810fb8ac240bb973ba5e72ae423c9&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:09.911663 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8eb3-d90d-4e62-b10a-ead1afa018ef None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.911948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8eb3-d90d-4e62-b10a-ead1afa018ef None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.912220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8eb3-d90d-4e62-b10a-ead1afa018ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.935716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c0b2-70f9-4383-aac7-ba64cdd5a1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:09.937856 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c0b2-70f9-4383-aac7-ba64cdd5a1aa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:09.938347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c0b2-70f9-4383-aac7-ba64cdd5a1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:09.938975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84c0b2-70f9-4383-aac7-ba64cdd5a1aa None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:09.940500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84c0b2-70f9-4383-aac7-ba64cdd5a1aa None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:09.942245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84c0b2-70f9-4383-aac7-ba64cdd5a1aa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:09.943618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-482d8eb3-d90d-4e62-b10a-ead1afa018ef None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:09.945312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-482d8eb3-d90d-4e62-b10a-ead1afa018ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:09.945513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 184/366] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:09 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:09.950945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c0b2-70f9-4383-aac7-ba64cdd5a1aa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.047821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:10.060099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 183/367] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:10.060099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d8eb3-d90d-4e62-b10a-ead1afa018ef None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.106004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:10.111814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84c0b2-70f9-4383-aac7-ba64cdd5a1aa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:10.150457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:10.151503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:10.151975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:10.152457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:10.153319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:10.153812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:10.155563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:10.165455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 185/368] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:10.166701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.198994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d8eb3-d90d-4e62-b10a-ead1afa018ef None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:10.246643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86be0b-174b-426b-b7a7-bbf97f3bc675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:10.247255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86be0b-174b-426b-b7a7-bbf97f3bc675 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:10.247528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86be0b-174b-426b-b7a7-bbf97f3bc675 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:10.247793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86be0b-174b-426b-b7a7-bbf97f3bc675 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:10.248911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86be0b-174b-426b-b7a7-bbf97f3bc675 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:10.250422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86be0b-174b-426b-b7a7-bbf97f3bc675 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:10.252399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 184/369] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:10 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:10.253268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86be0b-174b-426b-b7a7-bbf97f3bc675 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.303502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613740d-c389-4577-ab85-2d6c00873991 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:10.335392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:10.342597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8578d-5def-4bb4-b53b-ec1976489329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:10.343501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8578d-5def-4bb4-b53b-ec1976489329 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:10.343941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8578d-5def-4bb4-b53b-ec1976489329 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:10.349401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8578d-5def-4bb4-b53b-ec1976489329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:10.357559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8578d-5def-4bb4-b53b-ec1976489329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:10.358126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:10.362258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86be0b-174b-426b-b7a7-bbf97f3bc675 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4cf8578d-5def-4bb4-b53b-ec1976489329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:10.363200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:10.364098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:10.364903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 186/370] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:10.365566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8578d-5def-4bb4-b53b-ec1976489329 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.408513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb35388-5585-472d-8c3d-c63df1ab3138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:10.409124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35388-5585-472d-8c3d-c63df1ab3138 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:10.409396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35388-5585-472d-8c3d-c63df1ab3138 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:10.409661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb35388-5585-472d-8c3d-c63df1ab3138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:10.485984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb35388-5585-472d-8c3d-c63df1ab3138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:10.487388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb35388-5585-472d-8c3d-c63df1ab3138 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:10.488404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8578d-5def-4bb4-b53b-ec1976489329 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:10.536905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:10.537309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:10.537582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:10.537851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:10.538619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] RBAC: Adding query filter params (group.id=cb2810fb8ac240bb973ba5e72ae423c9, role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=ee1d1fb582804a18bbe932f7917df50c) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:10.538925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:10.540408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:10.546350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 187/371] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:10 2022] GET /identity/v3/role_assignments?group.id=cb2810fb8ac240bb973ba5e72ae423c9&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=4851e677104948daa4c8bcf195bd8608 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:10.547205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.620469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:10.626194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 185/372] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:10.633687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb35388-5585-472d-8c3d-c63df1ab3138 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.648678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:10.761091 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb35388-5585-472d-8c3d-c63df1ab3138 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:10.781600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96514f67-4724-4d81-bf5b-7740ea852fb4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:10.814006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190af744-a3d2-4e2e-9e52-61014cf79e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:10.814667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190af744-a3d2-4e2e-9e52-61014cf79e74 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:10.814943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190af744-a3d2-4e2e-9e52-61014cf79e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:10.815213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190af744-a3d2-4e2e-9e52-61014cf79e74 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:10.817649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190af744-a3d2-4e2e-9e52-61014cf79e74 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:10.819323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190af744-a3d2-4e2e-9e52-61014cf79e74 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:10.821798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 186/373] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:10 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:10.828359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190af744-a3d2-4e2e-9e52-61014cf79e74 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.832666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:10.833516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:10.833988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:10.834552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:10.835413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:10.835907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:10.837471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:10.857915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 188/374] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:10.863592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:10.982873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:11.014685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190af744-a3d2-4e2e-9e52-61014cf79e74 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:11.069403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299bd87-61f3-4044-8f19-05d77b1fe89c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:11.084710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a80d2-ff74-4b67-9d8c-8ef7db99afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:11.085399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a80d2-ff74-4b67-9d8c-8ef7db99afd0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:11.085674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a80d2-ff74-4b67-9d8c-8ef7db99afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:11.085938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a80d2-ff74-4b67-9d8c-8ef7db99afd0 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:11.088768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a80d2-ff74-4b67-9d8c-8ef7db99afd0 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:11.090211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a80d2-ff74-4b67-9d8c-8ef7db99afd0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:11.092391 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 187/375] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:10 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:11.099760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a80d2-ff74-4b67-9d8c-8ef7db99afd0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:11.115034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:11.142923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd52da-c7ef-4145-9605-b06378b24e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:11.143956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd52da-c7ef-4145-9605-b06378b24e34 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:11.144457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd52da-c7ef-4145-9605-b06378b24e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:11.144926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd52da-c7ef-4145-9605-b06378b24e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:11.232808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd52da-c7ef-4145-9605-b06378b24e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:11.234658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd52da-c7ef-4145-9605-b06378b24e34 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:11.325833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a80d2-ff74-4b67-9d8c-8ef7db99afd0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:11.358130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 189/376] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:11.364758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd52da-c7ef-4145-9605-b06378b24e34 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:11.401102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:11.431161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:11.432296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:11.432572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:11.432835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:11.433558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] RBAC: Adding query filter params (group.id=cb2810fb8ac240bb973ba5e72ae423c9, role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=ee1d1fb582804a18bbe932f7917df50c) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:11.433858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:11.435313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:11.437371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:11.449138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 188/377] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:11 2022] GET /identity/v3/role_assignments?group.id=cb2810fb8ac240bb973ba5e72ae423c9&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 260 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:11.497829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd52da-c7ef-4145-9605-b06378b24e34 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:11.538100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea018-debc-4564-8fe4-158139d21360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:11.539136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea018-debc-4564-8fe4-158139d21360 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:11.539698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea018-debc-4564-8fe4-158139d21360 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:11.540154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea018-debc-4564-8fe4-158139d21360 None admin] PATH_INFO: `/v3/projects/4075a07229a44c19829adfecb306b6b7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:11.541556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea018-debc-4564-8fe4-158139d21360 None admin] RBAC: Authorizing `identity:get_project(project_id=4075a07229a44c19829adfecb306b6b7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:11.543236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea018-debc-4564-8fe4-158139d21360 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:11.545503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 190/378] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:11 2022] GET /identity/v3/projects/4075a07229a44c19829adfecb306b6b7 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:11.551594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:11.668865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2560d-f34e-41e9-ab8a-39310f0db563 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:11.706271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d1b68-a379-4ae5-9a37-f43250d1ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:11.707251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1b68-a379-4ae5-9a37-f43250d1ac26 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:11.707708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1b68-a379-4ae5-9a37-f43250d1ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:11.708182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1b68-a379-4ae5-9a37-f43250d1ac26 None admin] PATH_INFO: `/v3/groups/fa8b4032f8a74441b1fe9f624845d204` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:11.714775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d1b68-a379-4ae5-9a37-f43250d1ac26 None admin] RBAC: Authorizing `identity:get_group(group_id=fa8b4032f8a74441b1fe9f624845d204)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:11.716517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d1b68-a379-4ae5-9a37-f43250d1ac26 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:11.718849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 189/379] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:11 2022] GET /identity/v3/groups/fa8b4032f8a74441b1fe9f624845d204 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:11.725074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea018-debc-4564-8fe4-158139d21360 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:11.817857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:11.836309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea018-debc-4564-8fe4-158139d21360 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:11.872409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84b89-6373-471f-ac83-e8a20ddbb623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:11.873310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84b89-6373-471f-ac83-e8a20ddbb623 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:11.873761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84b89-6373-471f-ac83-e8a20ddbb623 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:11.874234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84b89-6373-471f-ac83-e8a20ddbb623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:11.875160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84b89-6373-471f-ac83-e8a20ddbb623 None admin] RBAC: Adding query filter params (group.id=fa8b4032f8a74441b1fe9f624845d204, role.id=45149274288845b0a73e18fbb3394202, scope.project.id=4075a07229a44c19829adfecb306b6b7) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:11.875642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84b89-6373-471f-ac83-e8a20ddbb623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:11.877223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84b89-6373-471f-ac83-e8a20ddbb623 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:11.885682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 191/380] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:11 2022] GET /identity/v3/role_assignments?group.id=fa8b4032f8a74441b1fe9f624845d204&scope.project.id=4075a07229a44c19829adfecb306b6b7&role.id=45149274288845b0a73e18fbb3394202 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:12.201643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5809ceb-7301-4c51-8d37-5a203cb4da49 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:12.202124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5809ceb-7301-4c51-8d37-5a203cb4da49 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:12.202124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5809ceb-7301-4c51-8d37-5a203cb4da49 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:12.203764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 190/381] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:12.209169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e438c67-87a2-40bd-9d13-bb17eb5f19a5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:12.209615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e438c67-87a2-40bd-9d13-bb17eb5f19a5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:12.209805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e438c67-87a2-40bd-9d13-bb17eb5f19a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:12.228459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1e438c67-87a2-40bd-9d13-bb17eb5f19a5 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:12.230265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1e438c67-87a2-40bd-9d13-bb17eb5f19a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:12.304723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 192/382] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:12.327578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5809ceb-7301-4c51-8d37-5a203cb4da49 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:12.394534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254890a3-3248-4a24-b1fe-c467e57c4e83 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:12.394838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254890a3-3248-4a24-b1fe-c467e57c4e83 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:12.395092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254890a3-3248-4a24-b1fe-c467e57c4e83 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:12.397262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 193/383] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:12.404136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:12.408412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126660d-a80c-4f83-b2d5-068bdb4522c9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:12.408935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126660d-a80c-4f83-b2d5-068bdb4522c9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:12.409533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126660d-a80c-4f83-b2d5-068bdb4522c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:12.432839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f126660d-a80c-4f83-b2d5-068bdb4522c9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:12.436000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f126660d-a80c-4f83-b2d5-068bdb4522c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:12.472220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5809ceb-7301-4c51-8d37-5a203cb4da49 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:12.513466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9778dfd-ba60-4bae-aa57-1a32eaed2b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:12.514451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9778dfd-ba60-4bae-aa57-1a32eaed2b48 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:12.514950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9778dfd-ba60-4bae-aa57-1a32eaed2b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:12.515453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9778dfd-ba60-4bae-aa57-1a32eaed2b48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:12.532116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9778dfd-ba60-4bae-aa57-1a32eaed2b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f9778dfd-ba60-4bae-aa57-1a32eaed2b48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:12.533993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:12.534906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:12.535690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:12.539399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 191/384] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:12.544026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 194/385] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:12.547533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9778dfd-ba60-4bae-aa57-1a32eaed2b48 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:12.585755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126660d-a80c-4f83-b2d5-068bdb4522c9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:12.602884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:12.661800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9778dfd-ba60-4bae-aa57-1a32eaed2b48 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:12.691876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:12.700506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:12.701461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:12.701933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:12.702539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:12.703383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:12.706406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:12.706406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:12.715612 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 192/386] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:12.721533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:12.771053 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126660d-a80c-4f83-b2d5-068bdb4522c9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:12.856862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01bda-97d2-4bf0-aee1-b426072b252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:12.857624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01bda-97d2-4bf0-aee1-b426072b252e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:12.857974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01bda-97d2-4bf0-aee1-b426072b252e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:12.858312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01bda-97d2-4bf0-aee1-b426072b252e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:12.863344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304d75-7ba4-4a77-ab40-b429162d2211 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:12.891439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba01bda-97d2-4bf0-aee1-b426072b252e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:12.898748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810466fb-23cd-40ca-8e40-cf28012942db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:12.899652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810466fb-23cd-40ca-8e40-cf28012942db None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:12.900106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810466fb-23cd-40ca-8e40-cf28012942db None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:12.901089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810466fb-23cd-40ca-8e40-cf28012942db None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9ba01bda-97d2-4bf0-aee1-b426072b252e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:12.901218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:12.902049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:12.902886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 195/387] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:23:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:12.905403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810466fb-23cd-40ca-8e40-cf28012942db None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:12.908785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810466fb-23cd-40ca-8e40-cf28012942db None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:12.910950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 193/388] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:12 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:12.911481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01bda-97d2-4bf0-aee1-b426072b252e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:12.916002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810466fb-23cd-40ca-8e40-cf28012942db None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:13.009086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:13.030166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:13.050430 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01bda-97d2-4bf0-aee1-b426072b252e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.098310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bce62-7327-4c08-beb2-3087bda68aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:13.099179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bce62-7327-4c08-beb2-3087bda68aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.099607 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bce62-7327-4c08-beb2-3087bda68aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.100024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bce62-7327-4c08-beb2-3087bda68aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.100874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bce62-7327-4c08-beb2-3087bda68aa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:13.101207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810466fb-23cd-40ca-8e40-cf28012942db None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.101497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bce62-7327-4c08-beb2-3087bda68aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:13.103141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bce62-7327-4c08-beb2-3087bda68aa8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:13.117552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 196/389] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:13.119180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c503b-a177-4290-bc69-3e363ffaf34a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.119615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c503b-a177-4290-bc69-3e363ffaf34a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.120031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c503b-a177-4290-bc69-3e363ffaf34a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.123089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 197/390] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:13.123959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c503b-a177-4290-bc69-3e363ffaf34a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:13.139627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee336385-7cd8-499a-9213-dafbf7527b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:13.140428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee336385-7cd8-499a-9213-dafbf7527b9e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.140805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee336385-7cd8-499a-9213-dafbf7527b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.141172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee336385-7cd8-499a-9213-dafbf7527b9e None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.142745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee336385-7cd8-499a-9213-dafbf7527b9e None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:13.143969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee336385-7cd8-499a-9213-dafbf7527b9e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:13.146823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 194/391] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:12 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:13.148122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab7c7-9065-4e96-9608-4f8b050ee10b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.148501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab7c7-9065-4e96-9608-4f8b050ee10b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.148870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab7c7-9065-4e96-9608-4f8b050ee10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.169231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-c43ab7c7-9065-4e96-9608-4f8b050ee10b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:13.170628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c43ab7c7-9065-4e96-9608-4f8b050ee10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:13.245718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 195/392] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:13.246514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab7c7-9065-4e96-9608-4f8b050ee10b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:13.246914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c503b-a177-4290-bc69-3e363ffaf34a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.281337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:13.289438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a473-910e-42d1-b55c-085f420ed68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:13.290325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a473-910e-42d1-b55c-085f420ed68f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.290839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a473-910e-42d1-b55c-085f420ed68f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.291555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a473-910e-42d1-b55c-085f420ed68f None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.293045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411a473-910e-42d1-b55c-085f420ed68f None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:13.311140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411a473-910e-42d1-b55c-085f420ed68f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:13.311140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 198/393] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:13 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:13.311140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a473-910e-42d1-b55c-085f420ed68f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:13.311400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:13.350998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab7c7-9065-4e96-9608-4f8b050ee10b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.388876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ef705-8921-403a-94b4-0aa3b2908117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:13.389541 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ef705-8921-403a-94b4-0aa3b2908117 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.389836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ef705-8921-403a-94b4-0aa3b2908117 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.390335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ef705-8921-403a-94b4-0aa3b2908117 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb/groups/cb2810fb8ac240bb973ba5e72ae423c9/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.392059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ef705-8921-403a-94b4-0aa3b2908117 None admin] RBAC: Authorizing `identity:create_grant(project_id=33df3de83e2f4538b39277107129f1fb, group_id=cb2810fb8ac240bb973ba5e72ae423c9, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:13.393494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ef705-8921-403a-94b4-0aa3b2908117 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:13.415177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a473-910e-42d1-b55c-085f420ed68f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.460311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e09cb-63a1-43dc-a3aa-a1ec6b175253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:13.460941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e09cb-63a1-43dc-a3aa-a1ec6b175253 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.461217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e09cb-63a1-43dc-a3aa-a1ec6b175253 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.461582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e09cb-63a1-43dc-a3aa-a1ec6b175253 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.475780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e09cb-63a1-43dc-a3aa-a1ec6b175253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-406e09cb-63a1-43dc-a3aa-a1ec6b175253 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:13.481589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:13.482499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:13.483302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 199/394] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:13.484064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e09cb-63a1-43dc-a3aa-a1ec6b175253 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:13.518936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 196/395] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 10 08:23:13 2022] PUT /identity/v3/projects/33df3de83e2f4538b39277107129f1fb/groups/cb2810fb8ac240bb973ba5e72ae423c9/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:13.520818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ef705-8921-403a-94b4-0aa3b2908117 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:13.582233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:13.665378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e09cb-63a1-43dc-a3aa-a1ec6b175253 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.728043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ece45b-42b9-4761-90f1-4cfdb480d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:13.728711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ece45b-42b9-4761-90f1-4cfdb480d670 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.728994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ece45b-42b9-4761-90f1-4cfdb480d670 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.729267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ece45b-42b9-4761-90f1-4cfdb480d670 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.731517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ece45b-42b9-4761-90f1-4cfdb480d670 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:13.731643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ef705-8921-403a-94b4-0aa3b2908117 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.732958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ece45b-42b9-4761-90f1-4cfdb480d670 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:13.734613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 200/396] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:13 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:13.740561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ece45b-42b9-4761-90f1-4cfdb480d670 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:13.743124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:13.777894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:13.782100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:13.782100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:13.782100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:13.782100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:13.782100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:13.785040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:13.804379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 197/397] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:13.811634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:13.909314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ece45b-42b9-4761-90f1-4cfdb480d670 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.976193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1fb4d-1c54-4277-960a-14554e145eba None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:13.996311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:14.014626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60ff3-ab2b-44af-8410-35faaf6a37d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:14.015481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa58c3-c253-4c03-b1f1-c3e74b126e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:14.016345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa58c3-c253-4c03-b1f1-c3e74b126e0a None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.017105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60ff3-ab2b-44af-8410-35faaf6a37d3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.017521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60ff3-ab2b-44af-8410-35faaf6a37d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.017928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa58c3-c253-4c03-b1f1-c3e74b126e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.018334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60ff3-ab2b-44af-8410-35faaf6a37d3 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.018769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa58c3-c253-4c03-b1f1-c3e74b126e0a None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb/groups/cb2810fb8ac240bb973ba5e72ae423c9/roles/1cb2ff0f0c514fc19e6847a5c8e3a127` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.020504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60ff3-ab2b-44af-8410-35faaf6a37d3 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:14.023155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60ff3-ab2b-44af-8410-35faaf6a37d3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:14.023954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa58c3-c253-4c03-b1f1-c3e74b126e0a None admin] RBAC: Authorizing `identity:create_grant(project_id=33df3de83e2f4538b39277107129f1fb, group_id=cb2810fb8ac240bb973ba5e72ae423c9, role_id=1cb2ff0f0c514fc19e6847a5c8e3a127)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:14.025567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa58c3-c253-4c03-b1f1-c3e74b126e0a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:14.027415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 198/398] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:13 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:14.036405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60ff3-ab2b-44af-8410-35faaf6a37d3 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:14.082847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:14.111144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 201/399] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 10 08:23:13 2022] PUT /identity/v3/projects/33df3de83e2f4538b39277107129f1fb/groups/cb2810fb8ac240bb973ba5e72ae423c9/roles/1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:14.160786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60ff3-ab2b-44af-8410-35faaf6a37d3 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:14.177870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c497473-1907-47e8-a1ce-b3f70c013377 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.178424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c497473-1907-47e8-a1ce-b3f70c013377 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.178861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c497473-1907-47e8-a1ce-b3f70c013377 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.180407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 202/400] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:23:14.186702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560dc8-7989-4836-b4c0-6d78031bb898 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.187254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560dc8-7989-4836-b4c0-6d78031bb898 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.187691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560dc8-7989-4836-b4c0-6d78031bb898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.217476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8a560dc8-7989-4836-b4c0-6d78031bb898 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:14.221159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8a560dc8-7989-4836-b4c0-6d78031bb898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:14.243531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ee778-a5f4-494f-a2aa-d0568892a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:14.245051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee778-a5f4-494f-a2aa-d0568892a274 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.245736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee778-a5f4-494f-a2aa-d0568892a274 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.247512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ee778-a5f4-494f-a2aa-d0568892a274 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.250715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ee778-a5f4-494f-a2aa-d0568892a274 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:14.252667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ee778-a5f4-494f-a2aa-d0568892a274 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:14.256068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 199/401] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:14 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:14.262183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ee778-a5f4-494f-a2aa-d0568892a274 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:14.332569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 203/402] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:14.357305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560dc8-7989-4836-b4c0-6d78031bb898 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:14.392482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ee778-a5f4-494f-a2aa-d0568892a274 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:14.402674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:14.428595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f08081-e03a-4293-a003-61d4b144df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:14.429369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08081-e03a-4293-a003-61d4b144df48 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.429704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08081-e03a-4293-a003-61d4b144df48 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.430041 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08081-e03a-4293-a003-61d4b144df48 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c/groups/cb2810fb8ac240bb973ba5e72ae423c9/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.432113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08081-e03a-4293-a003-61d4b144df48 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d1fb582804a18bbe932f7917df50c, group_id=cb2810fb8ac240bb973ba5e72ae423c9, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:14.433633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08081-e03a-4293-a003-61d4b144df48 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:14.488354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560dc8-7989-4836-b4c0-6d78031bb898 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:14.506006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:14.523160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 200/403] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 10 08:23:14 2022] PUT /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c/groups/cb2810fb8ac240bb973ba5e72ae423c9/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:23:14.524833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6de6b-e3bb-4901-b133-57dd5d6c7dcc None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.524833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6de6b-e3bb-4901-b133-57dd5d6c7dcc None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.524833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6de6b-e3bb-4901-b133-57dd5d6c7dcc None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.531203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 201/404] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:14.536184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d639c-f65e-409d-b687-7244f758ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:14.537128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c27da3-01aa-432c-887e-104456b45402 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.537431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d639c-f65e-409d-b687-7244f758ddc8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.537534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c27da3-01aa-432c-887e-104456b45402 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.537709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c27da3-01aa-432c-887e-104456b45402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.538180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d639c-f65e-409d-b687-7244f758ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.538672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d639c-f65e-409d-b687-7244f758ddc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.552741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d639c-f65e-409d-b687-7244f758ddc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-214d639c-f65e-409d-b687-7244f758ddc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:14.559805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:14.561998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:14.562866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:14.565371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 204/405] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:23:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:14.574635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d639c-f65e-409d-b687-7244f758ddc8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:14.577050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a6c27da3-01aa-432c-887e-104456b45402 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:14.578335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a6c27da3-01aa-432c-887e-104456b45402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:14.694004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 202/406] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:14.715882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c27da3-01aa-432c-887e-104456b45402 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:14.764776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d639c-f65e-409d-b687-7244f758ddc8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:14.804775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:14.805379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.805654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.805924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.806778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:14.807083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:14.808596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:14.818696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 205/407] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:14.825962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:14.839552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:14.843288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c27da3-01aa-432c-887e-104456b45402 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:14.874867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:14.894003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b060-6e2b-4376-9200-5bdc18113370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:14.901189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b060-6e2b-4376-9200-5bdc18113370 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:14.909249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b060-6e2b-4376-9200-5bdc18113370 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:14.909249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b060-6e2b-4376-9200-5bdc18113370 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:14.924459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b060-6e2b-4376-9200-5bdc18113370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-16f7b060-6e2b-4376-9200-5bdc18113370 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:14.934063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:14.935121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:14.935988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:14.938507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 203/408] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:14.949798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b060-6e2b-4376-9200-5bdc18113370 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:14.997125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec8530-4713-47ea-a4fc-dabaa8ef5673 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:15.060268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332685a-11c3-40e9-875c-4c3a0d0d7776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:15.060961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332685a-11c3-40e9-875c-4c3a0d0d7776 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.061238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332685a-11c3-40e9-875c-4c3a0d0d7776 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.061508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332685a-11c3-40e9-875c-4c3a0d0d7776 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.063096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332685a-11c3-40e9-875c-4c3a0d0d7776 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:15.064536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332685a-11c3-40e9-875c-4c3a0d0d7776 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:15.069547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 206/409] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:14 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:15.072871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332685a-11c3-40e9-875c-4c3a0d0d7776 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:15.132753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b060-6e2b-4376-9200-5bdc18113370 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:15.172747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:15.173654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.174111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.174633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.175532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:15.176138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:15.178016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:15.187431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 204/410] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:15.195513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:15.221710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:15.306684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45497ff-64a6-4471-8e7a-d2e751d4f2fc None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:15.316523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332685a-11c3-40e9-875c-4c3a0d0d7776 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:15.331153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:15.344441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812953d7-c2af-47f2-b0a1-b48924089986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:15.348393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812953d7-c2af-47f2-b0a1-b48924089986 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.348393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812953d7-c2af-47f2-b0a1-b48924089986 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.348393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812953d7-c2af-47f2-b0a1-b48924089986 None admin] PATH_INFO: `/v3/groups/fa8b4032f8a74441b1fe9f624845d204` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.348393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812953d7-c2af-47f2-b0a1-b48924089986 None admin] RBAC: Authorizing `identity:get_group(group_id=fa8b4032f8a74441b1fe9f624845d204)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:15.348393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812953d7-c2af-47f2-b0a1-b48924089986 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:15.350131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 205/411] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:15 2022] GET /identity/v3/groups/fa8b4032f8a74441b1fe9f624845d204 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:15.356493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812953d7-c2af-47f2-b0a1-b48924089986 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:15.392105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef4b14-8437-475a-b3e8-044b159fc9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:15.392779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4b14-8437-475a-b3e8-044b159fc9fd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.393020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4b14-8437-475a-b3e8-044b159fc9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.393291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4b14-8437-475a-b3e8-044b159fc9fd None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.399167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef4b14-8437-475a-b3e8-044b159fc9fd None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:15.401154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef4b14-8437-475a-b3e8-044b159fc9fd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:15.403191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 207/412] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:15 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:15.411996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef4b14-8437-475a-b3e8-044b159fc9fd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:15.474956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:15.497038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812953d7-c2af-47f2-b0a1-b48924089986 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:15.586973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef4b14-8437-475a-b3e8-044b159fc9fd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:15.591495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d278-61a7-4433-aeed-55c01398d70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:15.592386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d278-61a7-4433-aeed-55c01398d70e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.592872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d278-61a7-4433-aeed-55c01398d70e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.593382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d278-61a7-4433-aeed-55c01398d70e None admin] PATH_INFO: `/v3/projects/4075a07229a44c19829adfecb306b6b7` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.602490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9d278-61a7-4433-aeed-55c01398d70e None admin] RBAC: Authorizing `identity:get_project(project_id=4075a07229a44c19829adfecb306b6b7)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:15.604805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9d278-61a7-4433-aeed-55c01398d70e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:15.606734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 206/413] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:15 2022] GET /identity/v3/projects/4075a07229a44c19829adfecb306b6b7 => generated 344 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:15.612717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d278-61a7-4433-aeed-55c01398d70e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:15.624517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08fc21-0648-4ba7-8802-1d200e792444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:15.625514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08fc21-0648-4ba7-8802-1d200e792444 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.626000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08fc21-0648-4ba7-8802-1d200e792444 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.626515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08fc21-0648-4ba7-8802-1d200e792444 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c/groups/cb2810fb8ac240bb973ba5e72ae423c9/roles/1cb2ff0f0c514fc19e6847a5c8e3a127` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.635562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08fc21-0648-4ba7-8802-1d200e792444 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee1d1fb582804a18bbe932f7917df50c, group_id=cb2810fb8ac240bb973ba5e72ae423c9, role_id=1cb2ff0f0c514fc19e6847a5c8e3a127)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:15.638613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08fc21-0648-4ba7-8802-1d200e792444 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:15.729912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 208/414] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 10 08:23:15 2022] PUT /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c/groups/cb2810fb8ac240bb973ba5e72ae423c9/roles/1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:15.748301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d278-61a7-4433-aeed-55c01398d70e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:15.796713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01868213-4352-44a2-b395-770a6f8b9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:15.797386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868213-4352-44a2-b395-770a6f8b9f02 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.797663 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868213-4352-44a2-b395-770a6f8b9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.797932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868213-4352-44a2-b395-770a6f8b9f02 None admin] PATH_INFO: `/v3/projects/4075a07229a44c19829adfecb306b6b7/groups/fa8b4032f8a74441b1fe9f624845d204/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.800002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01868213-4352-44a2-b395-770a6f8b9f02 None admin] RBAC: Authorizing `identity:create_grant(project_id=4075a07229a44c19829adfecb306b6b7, group_id=fa8b4032f8a74441b1fe9f624845d204, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:15.801451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01868213-4352-44a2-b395-770a6f8b9f02 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:15.875620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 207/415] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 10 08:23:15 2022] PUT /identity/v3/projects/4075a07229a44c19829adfecb306b6b7/groups/fa8b4032f8a74441b1fe9f624845d204/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:23:15.963737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fef5c-7ae4-4375-ab81-2871d767a372 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.964376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fef5c-7ae4-4375-ab81-2871d767a372 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.964849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fef5c-7ae4-4375-ab81-2871d767a372 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.966820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 209/416] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:15.972850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0185-a621-481f-bcbc-888d58482525 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:15.973188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0185-a621-481f-bcbc-888d58482525 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:15.973443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c0185-a621-481f-bcbc-888d58482525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:15.995025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f17c0185-a621-481f-bcbc-888d58482525 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:15.996161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f17c0185-a621-481f-bcbc-888d58482525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:16.008880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:16.075842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 208/417] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:16.098968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fef5c-7ae4-4375-ab81-2871d767a372 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:16.148578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:16.241265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fef5c-7ae4-4375-ab81-2871d767a372 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:16.292994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a666-6a75-47f8-ad76-b5b52917afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:16.293545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a666-6a75-47f8-ad76-b5b52917afaf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:16.293824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a666-6a75-47f8-ad76-b5b52917afaf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:16.294096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a666-6a75-47f8-ad76-b5b52917afaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:16.315388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246a666-6a75-47f8-ad76-b5b52917afaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b246a666-6a75-47f8-ad76-b5b52917afaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:16.320421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:16.321566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:16.322449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 210/418] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:16.327687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c0185-a621-481f-bcbc-888d58482525 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:16.450944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c0185-a621-481f-bcbc-888d58482525 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:16.486080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786ee62-ef8c-4f8f-aa6a-ccf8661f8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:16.486711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786ee62-ef8c-4f8f-aa6a-ccf8661f8699 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:16.486989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786ee62-ef8c-4f8f-aa6a-ccf8661f8699 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:16.487258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786ee62-ef8c-4f8f-aa6a-ccf8661f8699 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:16.487936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786ee62-ef8c-4f8f-aa6a-ccf8661f8699 None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:16.488234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786ee62-ef8c-4f8f-aa6a-ccf8661f8699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:16.489598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786ee62-ef8c-4f8f-aa6a-ccf8661f8699 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:16.498992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 209/419] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:16.504223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a666-6a75-47f8-ad76-b5b52917afaf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:16.628415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86d255-75fb-4e9f-84a7-23aabac89d6f None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:16.628751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86d255-75fb-4e9f-84a7-23aabac89d6f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:16.628876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86d255-75fb-4e9f-84a7-23aabac89d6f None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:16.630494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 210/420] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:23:16.635993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d6e1-751d-4d3f-bc8a-3cc23838fc0c None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:16.636276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d6e1-751d-4d3f-bc8a-3cc23838fc0c None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:16.636551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d6e1-751d-4d3f-bc8a-3cc23838fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:16.650836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:16.662850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a666-6a75-47f8-ad76-b5b52917afaf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:16.668354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9af6d6e1-751d-4d3f-bc8a-3cc23838fc0c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:16.669555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9af6d6e1-751d-4d3f-bc8a-3cc23838fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:16.681083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:16.709118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1622d47-8d1e-4c0d-8ac2-1884fc0cf0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:16.709729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1622d47-8d1e-4c0d-8ac2-1884fc0cf0ad None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:16.710004 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1622d47-8d1e-4c0d-8ac2-1884fc0cf0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:16.710277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1622d47-8d1e-4c0d-8ac2-1884fc0cf0ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:16.800026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 211/421] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 10 08:23:16.821654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1622d47-8d1e-4c0d-8ac2-1884fc0cf0ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:16.823738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1622d47-8d1e-4c0d-8ac2-1884fc0cf0ad None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:16.837090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6d6e1-751d-4d3f-bc8a-3cc23838fc0c None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:16.935929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:16.943721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 211/422] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:16.951631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1622d47-8d1e-4c0d-8ac2-1884fc0cf0ad None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.025730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6d6e1-751d-4d3f-bc8a-3cc23838fc0c None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.087486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5063-8a4c-4939-b639-cc3a36f3ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.088573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5063-8a4c-4939-b639-cc3a36f3ec89 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.088862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5063-8a4c-4939-b639-cc3a36f3ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.089619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5063-8a4c-4939-b639-cc3a36f3ec89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.102788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:17.104532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5063-8a4c-4939-b639-cc3a36f3ec89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-c4fd5063-8a4c-4939-b639-cc3a36f3ec89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:17.109411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:17.117753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:17.118673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 212/423] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:23:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:17.119991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1622d47-8d1e-4c0d-8ac2-1884fc0cf0ad None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.120077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f54-1dcc-4bd3-b009-9370c7ef148b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.120077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f54-1dcc-4bd3-b009-9370c7ef148b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.120077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f54-1dcc-4bd3-b009-9370c7ef148b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.120077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 213/424] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:17.120077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242f54-1dcc-4bd3-b009-9370c7ef148b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.152880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898df3-a5d1-4d9d-a227-448f0bcda9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.153811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898df3-a5d1-4d9d-a227-448f0bcda9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.154293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898df3-a5d1-4d9d-a227-448f0bcda9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.154701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898df3-a5d1-4d9d-a227-448f0bcda9b7 None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.155953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898df3-a5d1-4d9d-a227-448f0bcda9b7 None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:17.157492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898df3-a5d1-4d9d-a227-448f0bcda9b7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:17.159786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 212/425] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:16 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:17.161066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cdb0e-fab4-4902-9fea-e3959c768e46 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.161446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cdb0e-fab4-4902-9fea-e3959c768e46 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.161819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cdb0e-fab4-4902-9fea-e3959c768e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.182266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d44cdb0e-fab4-4902-9fea-e3959c768e46 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:17.184040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d44cdb0e-fab4-4902-9fea-e3959c768e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:17.230828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242f54-1dcc-4bd3-b009-9370c7ef148b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.248787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:17.260845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 213/426] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:17.262153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cdb0e-fab4-4902-9fea-e3959c768e46 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.281269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.281879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.282155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.282423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.283120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:17.283420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:17.284783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:17.299190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 214/427] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:17.300016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.366757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:17.376471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cdb0e-fab4-4902-9fea-e3959c768e46 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.410905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128cc0-ffb9-4573-b7be-7b0d7e4b8969 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.414278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1684-cf58-4731-853a-d8b14f272255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.415207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1684-cf58-4731-853a-d8b14f272255 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.415705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1684-cf58-4731-853a-d8b14f272255 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.416835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea1684-cf58-4731-853a-d8b14f272255 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.418177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea1684-cf58-4731-853a-d8b14f272255 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:17.419939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea1684-cf58-4731-853a-d8b14f272255 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:17.421871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 214/428] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:17 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:17.423074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1684-cf58-4731-853a-d8b14f272255 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.446699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356dc3d-a5c4-4821-a08a-4de264d889d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.447359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356dc3d-a5c4-4821-a08a-4de264d889d4 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.447636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356dc3d-a5c4-4821-a08a-4de264d889d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.447903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356dc3d-a5c4-4821-a08a-4de264d889d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.459397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356dc3d-a5c4-4821-a08a-4de264d889d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-b356dc3d-a5c4-4821-a08a-4de264d889d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:17.465372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:17.466279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 08:23:17.467145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:17.471536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 215/429] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:17.472198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356dc3d-a5c4-4821-a08a-4de264d889d4 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.493466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:17.539860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea1684-cf58-4731-853a-d8b14f272255 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.576953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c056d82-c7e2-4a24-89c8-5ca0ad50db2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.577813 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c056d82-c7e2-4a24-89c8-5ca0ad50db2b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.578190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c056d82-c7e2-4a24-89c8-5ca0ad50db2b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.578600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c056d82-c7e2-4a24-89c8-5ca0ad50db2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.580761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356dc3d-a5c4-4821-a08a-4de264d889d4 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.602702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:17.618359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.619242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.619663 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.620171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.621209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] RBAC: Adding query filter params (group.id=cb2810fb8ac240bb973ba5e72ae423c9, role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=33df3de83e2f4538b39277107129f1fb) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:17.621714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:17.623366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:17.629886 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 216/430] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:17 2022] GET /identity/v3/role_assignments?group.id=cb2810fb8ac240bb973ba5e72ae423c9&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=4851e677104948daa4c8bcf195bd8608 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:17.631025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.662489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c056d82-c7e2-4a24-89c8-5ca0ad50db2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:17.662489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c056d82-c7e2-4a24-89c8-5ca0ad50db2b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:17.729486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:17.775825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 215/431] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:17.784903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c056d82-c7e2-4a24-89c8-5ca0ad50db2b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.895405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588a9dc-2a85-4b70-9774-156081e1d6a3 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.930622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c056d82-c7e2-4a24-89c8-5ca0ad50db2b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:17.937743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.938388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.938742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.939022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.939712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] RBAC: Adding query filter params (name=member) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:17.940020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:17.941395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:17.954937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 217/432] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:23:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:17.960140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:17.992911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8980a-66d5-445c-8f84-26e28e25cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:17.993546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8980a-66d5-445c-8f84-26e28e25cd5b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:17.993823 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8980a-66d5-445c-8f84-26e28e25cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:17.994272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8980a-66d5-445c-8f84-26e28e25cd5b None admin] PATH_INFO: `/v3/projects/33df3de83e2f4538b39277107129f1fb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:17.995573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8980a-66d5-445c-8f84-26e28e25cd5b None admin] RBAC: Authorizing `identity:get_project(project_id=33df3de83e2f4538b39277107129f1fb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:17.997103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8980a-66d5-445c-8f84-26e28e25cd5b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:17.999050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 216/433] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:17 2022] GET /identity/v3/projects/33df3de83e2f4538b39277107129f1fb => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:18.004397 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8980a-66d5-445c-8f84-26e28e25cd5b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.018698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:18.050144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:18.088021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66e901-ac1a-4f89-b3aa-d412d64a192d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.132245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84604940-f13e-4ec3-a030-db7f612a96e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:18.132858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84604940-f13e-4ec3-a030-db7f612a96e2 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.133140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84604940-f13e-4ec3-a030-db7f612a96e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.133412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84604940-f13e-4ec3-a030-db7f612a96e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.144045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8980a-66d5-445c-8f84-26e28e25cd5b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.192242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa88938-2c62-4cc8-9bd5-29ff845bf493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:18.192888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa88938-2c62-4cc8-9bd5-29ff845bf493 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.193166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa88938-2c62-4cc8-9bd5-29ff845bf493 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.195056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa88938-2c62-4cc8-9bd5-29ff845bf493 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.195056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa88938-2c62-4cc8-9bd5-29ff845bf493 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:18.196679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa88938-2c62-4cc8-9bd5-29ff845bf493 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:18.202513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 217/434] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:18.202513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b578b69-4ad3-4cc0-b5c0-6e17bfaeb681 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.202513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b578b69-4ad3-4cc0-b5c0-6e17bfaeb681 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.202513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b578b69-4ad3-4cc0-b5c0-6e17bfaeb681 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.202513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 218/435] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:18.206528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b578b69-4ad3-4cc0-b5c0-6e17bfaeb681 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.224789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84604940-f13e-4ec3-a030-db7f612a96e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:18.226249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84604940-f13e-4ec3-a030-db7f612a96e2 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:18.284147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:18.324731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:18.331278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b578b69-4ad3-4cc0-b5c0-6e17bfaeb681 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.348187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 218/436] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:23:18.351779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c175ca-303a-4f9b-961f-e106056e3473 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.352062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c175ca-303a-4f9b-961f-e106056e3473 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.352332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c175ca-303a-4f9b-961f-e106056e3473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.365024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcac44-9e99-486e-854f-d89d47cc9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:18.365616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcac44-9e99-486e-854f-d89d47cc9666 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.365888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcac44-9e99-486e-854f-d89d47cc9666 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.366154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcac44-9e99-486e-854f-d89d47cc9666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.366900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcac44-9e99-486e-854f-d89d47cc9666 None admin] RBAC: Adding query filter params (group.id=cb2810fb8ac240bb973ba5e72ae423c9, role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=33df3de83e2f4538b39277107129f1fb) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:18.367199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcac44-9e99-486e-854f-d89d47cc9666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:18.368613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcac44-9e99-486e-854f-d89d47cc9666 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:18.370561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d2c175ca-303a-4f9b-961f-e106056e3473 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:18.371743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d2c175ca-303a-4f9b-961f-e106056e3473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:18.375082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 219/437] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/role_assignments?group.id=cb2810fb8ac240bb973ba5e72ae423c9&scope.project.id=33df3de83e2f4538b39277107129f1fb&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:18.380362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026ac1-451b-4d69-9471-64f75a13a1d7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.380647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026ac1-451b-4d69-9471-64f75a13a1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.381292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026ac1-451b-4d69-9471-64f75a13a1d7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.383232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 220/438] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:18.387455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23026ac1-451b-4d69-9471-64f75a13a1d7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.452608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 219/439] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:18.454282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9c171-44a0-4447-b813-6ecfa981df8d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.454778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9c171-44a0-4447-b813-6ecfa981df8d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.455183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9c171-44a0-4447-b813-6ecfa981df8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.475816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3ff9c171-44a0-4447-b813-6ecfa981df8d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:18.477049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3ff9c171-44a0-4447-b813-6ecfa981df8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:18.514567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23026ac1-451b-4d69-9471-64f75a13a1d7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.554104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 220/440] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:18.555033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9c171-44a0-4447-b813-6ecfa981df8d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.563847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:18.565364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b497b-242c-4aba-b196-984df14223a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:18.566356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b497b-242c-4aba-b196-984df14223a4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.566726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b497b-242c-4aba-b196-984df14223a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.567024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b497b-242c-4aba-b196-984df14223a4 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.568130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b497b-242c-4aba-b196-984df14223a4 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:18.569577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b497b-242c-4aba-b196-984df14223a4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:18.574661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 221/441] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:18.577428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b497b-242c-4aba-b196-984df14223a4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.613800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:18.673450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9c171-44a0-4447-b813-6ecfa981df8d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.695372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b497b-242c-4aba-b196-984df14223a4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.713732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de9ed-1efb-4b69-9c87-56cc01277909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:18.714371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de9ed-1efb-4b69-9c87-56cc01277909 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.714699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de9ed-1efb-4b69-9c87-56cc01277909 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.715092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de9ed-1efb-4b69-9c87-56cc01277909 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.727502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57de9ed-1efb-4b69-9c87-56cc01277909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-d57de9ed-1efb-4b69-9c87-56cc01277909 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:18.733055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:18.734003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:18.734867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 221/442] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:18.736157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de9ed-1efb-4b69-9c87-56cc01277909 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.738101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee36a6-49e8-479f-9968-82d0e9c990f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:18.739065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee36a6-49e8-479f-9968-82d0e9c990f7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.739065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee36a6-49e8-479f-9968-82d0e9c990f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.739479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee36a6-49e8-479f-9968-82d0e9c990f7 None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.741559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee36a6-49e8-479f-9968-82d0e9c990f7 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:18.743776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee36a6-49e8-479f-9968-82d0e9c990f7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:18.745333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 222/443] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:18.746545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee36a6-49e8-479f-9968-82d0e9c990f7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.803163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:18.838426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de9ed-1efb-4b69-9c87-56cc01277909 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.841579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:18.846442 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee36a6-49e8-479f-9968-82d0e9c990f7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.873629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85310e01-845b-4485-ab33-bf07b5157f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:18.874252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310e01-845b-4485-ab33-bf07b5157f2f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.874561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310e01-845b-4485-ab33-bf07b5157f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.874833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310e01-845b-4485-ab33-bf07b5157f2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.880792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:18.881447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:18.881729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:18.881996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:18.882682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:18.882981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:18.884332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:18.884905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85310e01-845b-4485-ab33-bf07b5157f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-85310e01-845b-4485-ab33-bf07b5157f2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:18.890182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:18.891311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:18.892481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 222/444] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:18.893157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85310e01-845b-4485-ab33-bf07b5157f2f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.894788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 223/445] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:18.897368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:18.996719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85310e01-845b-4485-ab33-bf07b5157f2f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:18.998235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38098cb-47aa-4769-8c4d-988b5f924a0f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.021873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:19.030819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.050985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.051180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.051302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.051408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.051494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.051587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.051678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.051760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] RBAC: Adding query filter params (group.id=cb2810fb8ac240bb973ba5e72ae423c9, role.id=4851e677104948daa4c8bcf195bd8608, scope.project.id=ee1d1fb582804a18bbe932f7917df50c) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:19.051841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:19.051919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.052089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.052089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.052252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.052252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 223/446] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/role_assignments?group.id=cb2810fb8ac240bb973ba5e72ae423c9&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=4851e677104948daa4c8bcf195bd8608 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:19.052252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:19.052462 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 224/447] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:19.052462 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:19.078841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:19.161442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243b50-ab79-4d67-9770-ef58fb8cafbe None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.166610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7532-0b16-482d-a12f-a9c8f768b3e4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.198855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336e298-b96d-4b04-bf4f-57982df98266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.199469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e298-b96d-4b04-bf4f-57982df98266 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.199754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e298-b96d-4b04-bf4f-57982df98266 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.200031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e298-b96d-4b04-bf4f-57982df98266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.210355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61015-4153-455c-b80a-2af0a924eed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.211082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61015-4153-455c-b80a-2af0a924eed7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.211448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61015-4153-455c-b80a-2af0a924eed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.211694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61015-4153-455c-b80a-2af0a924eed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.266026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:19.278500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336e298-b96d-4b04-bf4f-57982df98266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.279875 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336e298-b96d-4b04-bf4f-57982df98266 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.289657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a61015-4153-455c-b80a-2af0a924eed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.293115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a61015-4153-455c-b80a-2af0a924eed7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.315845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:19.397412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 224/448] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:19.403279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336e298-b96d-4b04-bf4f-57982df98266 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:19.409735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 225/449] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 08:23:19.415376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61015-4153-455c-b80a-2af0a924eed7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:19.491459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:19.500979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336e298-b96d-4b04-bf4f-57982df98266 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.510498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61015-4153-455c-b80a-2af0a924eed7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.529209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:19.533428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e59385-6e91-4045-b7e8-7ecb57da0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.534047 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e59385-6e91-4045-b7e8-7ecb57da0d47 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.534321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e59385-6e91-4045-b7e8-7ecb57da0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.534623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e59385-6e91-4045-b7e8-7ecb57da0d47 None admin] PATH_INFO: `/v3/projects/ee1d1fb582804a18bbe932f7917df50c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.535798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e59385-6e91-4045-b7e8-7ecb57da0d47 None admin] RBAC: Authorizing `identity:get_project(project_id=ee1d1fb582804a18bbe932f7917df50c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.537526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e59385-6e91-4045-b7e8-7ecb57da0d47 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.541939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 225/450] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:19 2022] GET /identity/v3/projects/ee1d1fb582804a18bbe932f7917df50c => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:19.543035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617481b2-9b50-4d1b-a410-adef85846ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.549653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617481b2-9b50-4d1b-a410-adef85846ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.549653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617481b2-9b50-4d1b-a410-adef85846ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.549653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617481b2-9b50-4d1b-a410-adef85846ad6 None admin] PATH_INFO: `/v3/projects/4075a07229a44c19829adfecb306b6b7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.549889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e59385-6e91-4045-b7e8-7ecb57da0d47 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:19.549964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617481b2-9b50-4d1b-a410-adef85846ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=4075a07229a44c19829adfecb306b6b7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.549964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617481b2-9b50-4d1b-a410-adef85846ad6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.549964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 226/451] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:23:19 2022] GET /identity/v3/projects/4075a07229a44c19829adfecb306b6b7 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:19.553706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617481b2-9b50-4d1b-a410-adef85846ad6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:19.642693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e59385-6e91-4045-b7e8-7ecb57da0d47 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.648387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617481b2-9b50-4d1b-a410-adef85846ad6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.676101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520b995-01d2-4dc1-b9b2-d0a757c4710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.676721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b995-01d2-4dc1-b9b2-d0a757c4710c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.676997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b995-01d2-4dc1-b9b2-d0a757c4710c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.677266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520b995-01d2-4dc1-b9b2-d0a757c4710c None admin] PATH_INFO: `/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.678368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520b995-01d2-4dc1-b9b2-d0a757c4710c None admin] RBAC: Authorizing `identity:get_group(group_id=cb2810fb8ac240bb973ba5e72ae423c9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.679820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520b995-01d2-4dc1-b9b2-d0a757c4710c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.681359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 226/452] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:19 2022] GET /identity/v3/groups/cb2810fb8ac240bb973ba5e72ae423c9 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:19.683588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529f6f-e607-4ad2-8ed6-2f0d9042fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.684217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529f6f-e607-4ad2-8ed6-2f0d9042fab4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.684488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529f6f-e607-4ad2-8ed6-2f0d9042fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.684755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529f6f-e607-4ad2-8ed6-2f0d9042fab4 None admin] PATH_INFO: `/v3/groups/fa8b4032f8a74441b1fe9f624845d204` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.685905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88529f6f-e607-4ad2-8ed6-2f0d9042fab4 None admin] RBAC: Authorizing `identity:get_group(group_id=fa8b4032f8a74441b1fe9f624845d204)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.687332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520b995-01d2-4dc1-b9b2-d0a757c4710c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:19.687436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88529f6f-e607-4ad2-8ed6-2f0d9042fab4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.693419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 227/453] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 10 08:23:19 2022] GET /identity/v3/groups/fa8b4032f8a74441b1fe9f624845d204 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:19.694306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529f6f-e607-4ad2-8ed6-2f0d9042fab4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:19.714929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:19.750269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:19.785348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520b995-01d2-4dc1-b9b2-d0a757c4710c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.792988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529f6f-e607-4ad2-8ed6-2f0d9042fab4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:19.818446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7a552-84d2-4318-a49b-9ce11c39cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.819062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7a552-84d2-4318-a49b-9ce11c39cc13 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.819336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7a552-84d2-4318-a49b-9ce11c39cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.819607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7a552-84d2-4318-a49b-9ce11c39cc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.820328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7a552-84d2-4318-a49b-9ce11c39cc13 None admin] RBAC: Adding query filter params (group.id=cb2810fb8ac240bb973ba5e72ae423c9, role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=ee1d1fb582804a18bbe932f7917df50c) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:19.820632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7a552-84d2-4318-a49b-9ce11c39cc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.822364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7a552-84d2-4318-a49b-9ce11c39cc13 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.826404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7a2c2-7b99-4d50-85a2-ae2be8c153ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:19.827042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a2c2-7b99-4d50-85a2-ae2be8c153ab None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:19.827321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a2c2-7b99-4d50-85a2-ae2be8c153ab None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:19.827592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a2c2-7b99-4d50-85a2-ae2be8c153ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:19.827913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 227/454] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:19 2022] GET /identity/v3/role_assignments?group.id=cb2810fb8ac240bb973ba5e72ae423c9&scope.project.id=ee1d1fb582804a18bbe932f7917df50c&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:19.828316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7a2c2-7b99-4d50-85a2-ae2be8c153ab None admin] RBAC: Adding query filter params (group.id=fa8b4032f8a74441b1fe9f624845d204, role.id=45149274288845b0a73e18fbb3394202, scope.project.id=4075a07229a44c19829adfecb306b6b7) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:19.828619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7a2c2-7b99-4d50-85a2-ae2be8c153ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:19.830047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7a2c2-7b99-4d50-85a2-ae2be8c153ab None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:19.836358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 228/455] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 10 08:23:19 2022] GET /identity/v3/role_assignments?group.id=fa8b4032f8a74441b1fe9f624845d204&scope.project.id=4075a07229a44c19829adfecb306b6b7&role.id=45149274288845b0a73e18fbb3394202 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:22.322719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fbee3-2557-45ef-87bf-00f6bd6bf09b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:22.323752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fbee3-2557-45ef-87bf-00f6bd6bf09b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:22.324251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fbee3-2557-45ef-87bf-00f6bd6bf09b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:22.326069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 228/456] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:22.331853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12080e9-1cea-4dc5-ab51-3783fdc30bd8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:22.332292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12080e9-1cea-4dc5-ab51-3783fdc30bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:22.332379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12080e9-1cea-4dc5-ab51-3783fdc30bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:22.359500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a12080e9-1cea-4dc5-ab51-3783fdc30bd8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:22.360705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a12080e9-1cea-4dc5-ab51-3783fdc30bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:22.455176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 229/457] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:22.468669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b516bd-4629-4512-ad32-92b16a5cb818 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:22.469247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b516bd-4629-4512-ad32-92b16a5cb818 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:22.469737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b516bd-4629-4512-ad32-92b16a5cb818 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:22.472497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 229/458] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:22.476826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb787c-a9e5-4042-ae82-63478ed9f9e9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:22.477336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb787c-a9e5-4042-ae82-63478ed9f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:22.477795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb787c-a9e5-4042-ae82-63478ed9f9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:22.480344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b516bd-4629-4512-ad32-92b16a5cb818 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:22.498158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-17eb787c-a9e5-4042-ae82-63478ed9f9e9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:22.499365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-17eb787c-a9e5-4042-ae82-63478ed9f9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:22.582970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:22.643804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:22.656836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b516bd-4629-4512-ad32-92b16a5cb818 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:22.658777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 230/459] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:22.701455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:22.702089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:22.702368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:22.702670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:22.710310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb787c-a9e5-4042-ae82-63478ed9f9e9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:22.713943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:22.715470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:22.747036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:22.748040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:22.748882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:22.748882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:22.748882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:22.753748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 230/460] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:22.759906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:22.882456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb787c-a9e5-4042-ae82-63478ed9f9e9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:22.906341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e37523-db8f-4bdc-b5e9-c2f0f31eefda None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:22.951176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:22.952002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:22.952418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:22.952825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:22.958760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:22.963226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:22.963521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:22.963800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:22.964460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:22.964768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:22.966148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:22.972568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:22.974029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:22.982630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 231/461] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:22.985155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:22.990184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:22.997872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:22.999092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:23.000054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:23.000054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:23.000054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:23.000054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 231/462] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:23.005188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:23.045532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:23.131946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06098eb0-a3ec-43f8-a2b1-ef034254f586 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:23.141794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f65b9-ea08-4cef-b158-d6be1141d300 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:23.167420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ea135-7200-445c-bd6c-7a9717078e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:23.168029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea135-7200-445c-bd6c-7a9717078e77 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.168306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea135-7200-445c-bd6c-7a9717078e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.168754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea135-7200-445c-bd6c-7a9717078e77 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.169407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ea135-7200-445c-bd6c-7a9717078e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:23.169713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ea135-7200-445c-bd6c-7a9717078e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:23.171113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ea135-7200-445c-bd6c-7a9717078e77 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:23.177252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d1060-2996-45f3-a215-c22f6d9fad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:23.177849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d1060-2996-45f3-a215-c22f6d9fad9b None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.178127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d1060-2996-45f3-a215-c22f6d9fad9b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.178393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d1060-2996-45f3-a215-c22f6d9fad9b None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.179049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d1060-2996-45f3-a215-c22f6d9fad9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:23.180456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d1060-2996-45f3-a215-c22f6d9fad9b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:23.184406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 232/463] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:23.190511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588fab1-05d0-4c74-a975-d420303fb3d4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.190511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588fab1-05d0-4c74-a975-d420303fb3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.190511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588fab1-05d0-4c74-a975-d420303fb3d4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.190511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 233/464] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:23.190511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697d67d-7795-41a9-bd9e-b9f2bb997195 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.190511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697d67d-7795-41a9-bd9e-b9f2bb997195 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.190940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697d67d-7795-41a9-bd9e-b9f2bb997195 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.190940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 234/465] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:23.190940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697d67d-7795-41a9-bd9e-b9f2bb997195 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:23.274514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 232/466] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:23:22 2022] POST /identity/v3/users => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:23:23.275736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a08fb-e0df-48b4-be8f-a92924d694e1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.276021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a08fb-e0df-48b4-be8f-a92924d694e1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.276335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a08fb-e0df-48b4-be8f-a92924d694e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.300553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:23.304141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-728a08fb-e0df-48b4-be8f-a92924d694e1 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:23.305406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-728a08fb-e0df-48b4-be8f-a92924d694e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:23.313255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697d67d-7795-41a9-bd9e-b9f2bb997195 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:23.363300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ede80-6ff9-44cb-8d39-9989bd3dddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:23.364154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ede80-6ff9-44cb-8d39-9989bd3dddfa None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.365103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ede80-6ff9-44cb-8d39-9989bd3dddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.365525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ede80-6ff9-44cb-8d39-9989bd3dddfa None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.366624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ede80-6ff9-44cb-8d39-9989bd3dddfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:23.368896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ede80-6ff9-44cb-8d39-9989bd3dddfa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:23.372491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:23.394883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 233/467] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:23.394883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa841-6389-4659-9523-69590663c504 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.394883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa841-6389-4659-9523-69590663c504 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.394883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fa841-6389-4659-9523-69590663c504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.414842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-5b9fa841-6389-4659-9523-69590663c504 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:23.416867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5b9fa841-6389-4659-9523-69590663c504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:23.465212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 235/468] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:23:23 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:23.466075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ede80-6ff9-44cb-8d39-9989bd3dddfa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:23.496928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 234/469] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:23.537173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fa841-6389-4659-9523-69590663c504 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:23.601175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ede80-6ff9-44cb-8d39-9989bd3dddfa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:23.638334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:23.639125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.639406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.639674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.656228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:23.656228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:23.663987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:23.668301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fa841-6389-4659-9523-69590663c504 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:23.671248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:23.672144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:23.673038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:23.673038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:23.673038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:23.673038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 236/470] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:23.679635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:23.700287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:23.728724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:23.729807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.730336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.730832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.742423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:23.745504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:23.762937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:23.763894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:23.765190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:23.765190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:23.765190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:23.767123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 235/471] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:23.776357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:23.801991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763bc80-688d-40a2-a214-620a6ca4ae66 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:23.846879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:23.848116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.848845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.849599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.850451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:23.851626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:23.853557 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:23.870425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 237/472] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:23.878688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:23.922969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd947-a1d2-42e1-85b6-4090abc98b68 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:23.959999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:23.960653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:23.961270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:23.961549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:23.961822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:23.962494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:23.962854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:23.964842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:23.980219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 236/473] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:23.986732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:24.014145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beaf20-7ce5-4070-a915-53567e3ea6ae None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:24.020308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:24.088146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd25ee-29e8-448e-a1a2-a0d2772cb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:24.088856 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd25ee-29e8-448e-a1a2-a0d2772cb20d None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:24.089028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd25ee-29e8-448e-a1a2-a0d2772cb20d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:24.089292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd25ee-29e8-448e-a1a2-a0d2772cb20d None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:24.089930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd25ee-29e8-448e-a1a2-a0d2772cb20d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:24.091406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd25ee-29e8-448e-a1a2-a0d2772cb20d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:24.096368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bbcb6-2de4-44da-bf60-9c3447592d07 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:24.133674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79285cf-8307-4dbb-be2d-854f8f04a477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:24.135638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79285cf-8307-4dbb-be2d-854f8f04a477 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:24.136594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79285cf-8307-4dbb-be2d-854f8f04a477 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:24.137046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79285cf-8307-4dbb-be2d-854f8f04a477 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:24.138032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79285cf-8307-4dbb-be2d-854f8f04a477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:24.139785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79285cf-8307-4dbb-be2d-854f8f04a477 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:24.206129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 238/474] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:23:23 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:24.214496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f81384-ecc2-42d7-8b67-02fe31e6d525 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:24.214696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f81384-ecc2-42d7-8b67-02fe31e6d525 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:24.215096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f81384-ecc2-42d7-8b67-02fe31e6d525 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:24.216637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 239/475] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:24.223088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1786b-f5b1-47f7-bbf8-394918ee4563 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:24.223431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1786b-f5b1-47f7-bbf8-394918ee4563 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:24.223707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1786b-f5b1-47f7-bbf8-394918ee4563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:24.246141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 237/476] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:23:23 2022] POST /identity/v3/users => generated 249 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:24.250412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fcb1786b-f5b1-47f7-bbf8-394918ee4563 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:24.251801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fcb1786b-f5b1-47f7-bbf8-394918ee4563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:24.336982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 240/477] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:24.360479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79285cf-8307-4dbb-be2d-854f8f04a477 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:24.468985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:24.487278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79285cf-8307-4dbb-be2d-854f8f04a477 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:24.524547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:24.525152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:24.525450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:24.525719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:24.526381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:24.527938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:24.562987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.sql.core [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 08:23:24.562987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 08:23:24.562987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [parameters: {'id': '84b544b60edf429db9ed2a4ace0210d7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 08:23:24.562987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application conn.query(q) Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application result.read() Aug 10 08:23:24.579450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 08:23:24.580364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application next(self.gen) Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application yield resource Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application next(self.gen) Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise self.value Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application session.commit() Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 08:23:24.581490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.session.flush() Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application compat.raise_( Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 08:23:24.582400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 08:23:24.583323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application conn.query(q) Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application result.read() Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 08:23:24.584799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [parameters: {'id': '84b544b60edf429db9ed2a4ace0210d7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:24.585931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 08:23:24.587040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:24.590085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 238/478] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 10 08:23:24 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:24.595481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1786b-f5b1-47f7-bbf8-394918ee4563 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:24.650952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:24.713621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1786b-f5b1-47f7-bbf8-394918ee4563 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:24.750254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589db2-ce86-4b07-8391-fb0f9f45fbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:24.750878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589db2-ce86-4b07-8391-fb0f9f45fbba None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:24.751222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589db2-ce86-4b07-8391-fb0f9f45fbba None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:24.751498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589db2-ce86-4b07-8391-fb0f9f45fbba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:24.762413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589db2-ce86-4b07-8391-fb0f9f45fbba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-85589db2-ce86-4b07-8391-fb0f9f45fbba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:24.768399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:24.769293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:24.770221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 241/479] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:23:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:24.779525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:24.920101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8e120-c67d-4e13-b2dc-de3ae8fd7e1f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:24.954326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e346e-ef5e-4a52-afa9-66ac2fa440d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:24.954959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e346e-ef5e-4a52-afa9-66ac2fa440d1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:24.955230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e346e-ef5e-4a52-afa9-66ac2fa440d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:24.955491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e346e-ef5e-4a52-afa9-66ac2fa440d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:24.956146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e346e-ef5e-4a52-afa9-66ac2fa440d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:24.956507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e346e-ef5e-4a52-afa9-66ac2fa440d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:24.957857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e346e-ef5e-4a52-afa9-66ac2fa440d1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:24.966799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 239/480] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:26.030303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c737be-e72b-4185-9f19-aa95e84af243 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.030839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c737be-e72b-4185-9f19-aa95e84af243 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.030914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c737be-e72b-4185-9f19-aa95e84af243 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.032216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 242/481] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:26.037388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82492-14e2-4b03-a3ff-312c8cd47e40 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.037811 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82492-14e2-4b03-a3ff-312c8cd47e40 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.037980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82492-14e2-4b03-a3ff-312c8cd47e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.063534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a1a82492-14e2-4b03-a3ff-312c8cd47e40 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:26.064757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a1a82492-14e2-4b03-a3ff-312c8cd47e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:26.073037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:26.097657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962707d-c290-450b-8dc8-3420b6c0a1a5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.097955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962707d-c290-450b-8dc8-3420b6c0a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.098198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962707d-c290-450b-8dc8-3420b6c0a1a5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.099828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 243/482] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:23:26.115616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d478c3-2710-4592-ac14-8d1d48e52451 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.116184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d478c3-2710-4592-ac14-8d1d48e52451 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.116669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d478c3-2710-4592-ac14-8d1d48e52451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.145034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b6d478c3-2710-4592-ac14-8d1d48e52451 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:26.147746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b6d478c3-2710-4592-ac14-8d1d48e52451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:26.181517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 240/483] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:26.211375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82492-14e2-4b03-a3ff-312c8cd47e40 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:26.315310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82492-14e2-4b03-a3ff-312c8cd47e40 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:26.324672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 244/484] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:26.350354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b955a-2e62-4c83-b1c8-fbbd108ec227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:26.351017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b955a-2e62-4c83-b1c8-fbbd108ec227 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.351294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b955a-2e62-4c83-b1c8-fbbd108ec227 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.351564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b955a-2e62-4c83-b1c8-fbbd108ec227 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.362061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b955a-2e62-4c83-b1c8-fbbd108ec227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:26.363332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d478c3-2710-4592-ac14-8d1d48e52451 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-dc5b955a-2e62-4c83-b1c8-fbbd108ec227 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:26.367033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:26.367931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:26.368742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 241/485] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:26.375494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b955a-2e62-4c83-b1c8-fbbd108ec227 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:26.388929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:26.485816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b955a-2e62-4c83-b1c8-fbbd108ec227 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:26.514718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:26.553092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:26.554057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.554555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.555023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.555884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:26.556429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:26.557993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:26.573302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 242/486] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:26.581451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:26.638374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d478c3-2710-4592-ac14-8d1d48e52451 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:26.645635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:26.683877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13989e-4365-4105-b53e-8240dff1ced6 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:26.708811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd31f-1c72-4dfd-b47a-17c9799ed3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:26.709198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd31f-1c72-4dfd-b47a-17c9799ed3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.709500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd31f-1c72-4dfd-b47a-17c9799ed3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.709770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd31f-1c72-4dfd-b47a-17c9799ed3b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.723368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:26.724294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.724828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.725298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.730617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bd31f-1c72-4dfd-b47a-17c9799ed3b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:26.737146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:26.738854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-772bd31f-1c72-4dfd-b47a-17c9799ed3b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:26.747616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:26.748529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:26.749322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 245/487] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:26.754731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd31f-1c72-4dfd-b47a-17c9799ed3b1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:26.757832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:26.758783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:26.760177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:26.760177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:26.760177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:26.762734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 243/488] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:26.768362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:26.875480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4299-74e5-46a9-b692-ab78dd336099 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:26.894269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:26.894877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:26.905213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd31f-1c72-4dfd-b47a-17c9799ed3b1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:26.914751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6440245-8da2-4c04-b8fb-8ad2f1a1d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:26.915615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440245-8da2-4c04-b8fb-8ad2f1a1d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.915727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440245-8da2-4c04-b8fb-8ad2f1a1d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.915969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440245-8da2-4c04-b8fb-8ad2f1a1d4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.916619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6440245-8da2-4c04-b8fb-8ad2f1a1d4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:26.916917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6440245-8da2-4c04-b8fb-8ad2f1a1d4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:26.918526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6440245-8da2-4c04-b8fb-8ad2f1a1d4a9 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:26.935937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 244/489] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:26.935937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698d9f6-3e3e-4009-a1fa-ce3e2bc30c0b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.935937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698d9f6-3e3e-4009-a1fa-ce3e2bc30c0b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.935937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698d9f6-3e3e-4009-a1fa-ce3e2bc30c0b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.935937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 245/490] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:26.940573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698d9f6-3e3e-4009-a1fa-ce3e2bc30c0b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:26.955666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaca55-8ae4-4319-b339-194b2e653cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:26.956698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaca55-8ae4-4319-b339-194b2e653cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.957365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaca55-8ae4-4319-b339-194b2e653cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.958218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaca55-8ae4-4319-b339-194b2e653cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:26.959405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaca55-8ae4-4319-b339-194b2e653cb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:26.959917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaca55-8ae4-4319-b339-194b2e653cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:26.961960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaca55-8ae4-4319-b339-194b2e653cb0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:26.974025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 246/491] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:26.976288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba367330-0772-42b6-b4e6-0230d2229f13 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:26.976791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba367330-0772-42b6-b4e6-0230d2229f13 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:26.977265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba367330-0772-42b6-b4e6-0230d2229f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.000294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ba367330-0772-42b6-b4e6-0230d2229f13 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:27.001467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ba367330-0772-42b6-b4e6-0230d2229f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:27.067495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698d9f6-3e3e-4009-a1fa-ce3e2bc30c0b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.078510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 247/492] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:27.078510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba367330-0772-42b6-b4e6-0230d2229f13 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.113610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949eb711-606a-43d9-b9e2-a163d5a4524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.114249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eb711-606a-43d9-b9e2-a163d5a4524c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.114555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eb711-606a-43d9-b9e2-a163d5a4524c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.114830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eb711-606a-43d9-b9e2-a163d5a4524c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.122790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949eb711-606a-43d9-b9e2-a163d5a4524c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:27.124652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949eb711-606a-43d9-b9e2-a163d5a4524c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-949eb711-606a-43d9-b9e2-a163d5a4524c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:27.137788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:27.138770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:27.139774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:27.143574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 246/493] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:23:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:27.144796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76ea2-ac19-490e-9be8-7c7d179b1f15 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.145082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76ea2-ac19-490e-9be8-7c7d179b1f15 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.145360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76ea2-ac19-490e-9be8-7c7d179b1f15 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.146764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 247/494] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:27.147305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e76ea2-ac19-490e-9be8-7c7d179b1f15 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.174263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:27.186779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba367330-0772-42b6-b4e6-0230d2229f13 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.187244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:27.227827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.229066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.229348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.229732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.240877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:27.242431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:27.255953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e76ea2-ac19-490e-9be8-7c7d179b1f15 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:27.257713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:27.258636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:27.259529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:27.259529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:27.259529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:27.259529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 248/495] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:27.259752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.296435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df730a8-e1d8-4a84-9a4d-ed840c1c124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.297062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df730a8-e1d8-4a84-9a4d-ed840c1c124e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.297338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df730a8-e1d8-4a84-9a4d-ed840c1c124e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.297608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df730a8-e1d8-4a84-9a4d-ed840c1c124e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.308004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df730a8-e1d8-4a84-9a4d-ed840c1c124e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-1df730a8-e1d8-4a84-9a4d-ed840c1c124e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:27.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:27.314017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:27.314902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 248/496] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:27.315587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cee678-8bb7-45c8-9158-874b10a49807 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.316142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cee678-8bb7-45c8-9158-874b10a49807 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.316142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cee678-8bb7-45c8-9158-874b10a49807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.334255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-31cee678-8bb7-45c8-9158-874b10a49807 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:27.335463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-31cee678-8bb7-45c8-9158-874b10a49807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:27.369054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b62a9-6cef-4f1c-9e57-3b4c43ecc2f2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.403416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.403615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 249/497] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:27.404018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.404295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.404389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cee678-8bb7-45c8-9158-874b10a49807 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.404563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.405297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:27.405603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:27.407079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:27.430977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:27.437941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:27.449972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 249/498] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:27.450821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.502768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cee678-8bb7-45c8-9158-874b10a49807 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.536008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ad167-1414-4bb2-95f4-2453b235f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.536532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad167-1414-4bb2-95f4-2453b235f225 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.536806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad167-1414-4bb2-95f4-2453b235f225 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.537075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad167-1414-4bb2-95f4-2453b235f225 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.537712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ad167-1414-4bb2-95f4-2453b235f225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:27.538011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ad167-1414-4bb2-95f4-2453b235f225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:27.539420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ad167-1414-4bb2-95f4-2453b235f225 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:27.548052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a51a73-ecbd-4a74-931d-ebc959a80fce None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.550872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 250/499] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:27.552153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b56d-4a84-4044-92a4-ecac58e909de None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.552435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b56d-4a84-4044-92a4-ecac58e909de None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.552702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9b56d-4a84-4044-92a4-ecac58e909de None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.553895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 251/500] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:27.554605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9b56d-4a84-4044-92a4-ecac58e909de None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.586324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.586955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.587231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.587499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.588160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:27.588456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:27.589923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:27.597844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 250/501] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:27.598662 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.643907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:27.656137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:27.658921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9b56d-4a84-4044-92a4-ecac58e909de None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.691977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac76add-7111-485a-829c-b70641ac85b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.692596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac76add-7111-485a-829c-b70641ac85b3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.693088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac76add-7111-485a-829c-b70641ac85b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.693347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac76add-7111-485a-829c-b70641ac85b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.696873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6cc7b-0355-4e8e-84ee-77dce1264978 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.703365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac76add-7111-485a-829c-b70641ac85b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-4ac76add-7111-485a-829c-b70641ac85b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:27.708357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:27.709326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 252/502] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:27.710134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac76add-7111-485a-829c-b70641ac85b3 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.732475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7845-45d5-4f29-96e0-ac15e3845c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.733075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7845-45d5-4f29-96e0-ac15e3845c44 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.733373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7845-45d5-4f29-96e0-ac15e3845c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.733628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7845-45d5-4f29-96e0-ac15e3845c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.799268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7845-45d5-4f29-96e0-ac15e3845c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:27.800657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7845-45d5-4f29-96e0-ac15e3845c44 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:27.807852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac76add-7111-485a-829c-b70641ac85b3 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:27.841070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20e705-5d48-47eb-973d-1938488ab602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:27.841686 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20e705-5d48-47eb-973d-1938488ab602 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.841965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20e705-5d48-47eb-973d-1938488ab602 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.842239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20e705-5d48-47eb-973d-1938488ab602 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.849476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20e705-5d48-47eb-973d-1938488ab602 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:27.850957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20e705-5d48-47eb-973d-1938488ab602 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:27.859226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-5e20e705-5d48-47eb-973d-1938488ab602 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:27.863313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:27.864217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:27.865130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 253/503] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:27.865696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7202dd-e0c2-46c8-8952-f307c6333859 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:27.865760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7202dd-e0c2-46c8-8952-f307c6333859 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:27.866288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7202dd-e0c2-46c8-8952-f307c6333859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:27.878077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:27.883477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7e7202dd-e0c2-46c8-8952-f307c6333859 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:27.884695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7e7202dd-e0c2-46c8-8952-f307c6333859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:27.901664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 251/504] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:27.902493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7845-45d5-4f29-96e0-ac15e3845c44 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:27.954517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 254/505] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:27.955535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7202dd-e0c2-46c8-8952-f307c6333859 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.009396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7845-45d5-4f29-96e0-ac15e3845c44 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.043023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.043650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.043926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.044198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.053435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7202dd-e0c2-46c8-8952-f307c6333859 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.054168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.055690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:28.069647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:28.070833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:28.071708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:28.071708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:28.071708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:28.071708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 252/506] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:28.071708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.085977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.089736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.090349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.090670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.090938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.092229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:28.092229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.093275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.095558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.101549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 255/507] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:28.102318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.174088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20461c7c-0ef5-4450-848f-10a3789a062f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.199359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753e220-8096-427a-88d4-bdcf63d1ffa6 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.207673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.208262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.208553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.208803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.209521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:28.209824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.211265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.228636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 253/508] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:28.229417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.233915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.234570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.234843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.248610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.248610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.248610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:28.262260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:28.264061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:28.265707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:28.265707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:28.265707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:28.265707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 256/509] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:28.265707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.296106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.317547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.325449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ebb52-7117-40c5-a674-1ce7904c129c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.358092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.358746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.359017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.359284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.367198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a754c3-22e5-45d7-bcbf-951ac1064ab0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.369537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.371017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:28.384994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:28.385895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:28.387075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:28.387075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:28.387075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:28.387075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 254/510] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:28.387316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.404946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.405542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.405816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.406083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.406748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:28.407043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.408385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.419901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 257/511] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:28.420844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.484089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565ac2-ca62-4270-abeb-d5f2b9bf381c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.505639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.517550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5052c7-f5bd-47a2-9b15-2c48d37bf38d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.517680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.523668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.523668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.523668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.528538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.529422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.530907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:28.544571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:28.545634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:28.546687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:28.546687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:28.546687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:28.551549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 255/512] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:28.552078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e28d2-a99d-4e84-9fca-5ad763c98c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.552345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.552939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e28d2-a99d-4e84-9fca-5ad763c98c94 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.553290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e28d2-a99d-4e84-9fca-5ad763c98c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.553563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e28d2-a99d-4e84-9fca-5ad763c98c94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.620450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e28d2-a99d-4e84-9fca-5ad763c98c94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.621845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e28d2-a99d-4e84-9fca-5ad763c98c94 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.649791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3404e-a951-4912-83b4-90cf48915068 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.682483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.683082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.683354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.683624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.684255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:28.684552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.685915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.698588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 256/513] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:28.699367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.717459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 258/514] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:28.718299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e28d2-a99d-4e84-9fca-5ad763c98c94 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.729483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.733396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.796237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28c08e-3509-4a07-bb49-92f6aae2f03a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.814784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e28d2-a99d-4e84-9fca-5ad763c98c94 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.830308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.830933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.831215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.831480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.832116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:28.832415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.833787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.845312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 257/515] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:28.846079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.848391 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.849005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.849277 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.850103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.856571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.857996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:28.870031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:28.871186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 259/516] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:28.872335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:28.940163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.943411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:28.948163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d6c86-0c6f-4de0-a1ed-eebd07f0ce5f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.974073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe4d36-afa7-4ece-b518-70c4ef1a3e66 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:28.980987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:28.981587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:28.981861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:28.982130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:28.982810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:28.983106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:28.984483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:28.995804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 258/517] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:28.996578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.006257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.006918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.007195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.007464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.014858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.016384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:29.029329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:29.030351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 260/518] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:29.031279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.097605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d80ca-dff8-437a-91be-a179774df394 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.129930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.130511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.130793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.131060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.133221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bda32e-aee3-4bee-9fa8-f614ac927305 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.141911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.143572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:29.157893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:29.159032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:29.160040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:29.160040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:29.160040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:29.160040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 259/519] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:29.160040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.164472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:29.168582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:29.170196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570a55c-4837-465b-becc-07feb4b76aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.170818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570a55c-4837-465b-becc-07feb4b76aa6 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.175877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570a55c-4837-465b-becc-07feb4b76aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.175877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570a55c-4837-465b-becc-07feb4b76aa6 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.175877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570a55c-4837-465b-becc-07feb4b76aa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.175877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570a55c-4837-465b-becc-07feb4b76aa6 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.253924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98d2ce-1aaf-4b6f-9ba1-58fa05f22332 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.286156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.286763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.287037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.287302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.288014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:29.288312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.289716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.305549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 260/520] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 10 08:23:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:29.306840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.354503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 261/521] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:23:29 2022] POST /identity/v3/users => generated 247 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:29.354503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570a55c-4837-465b-becc-07feb4b76aa6 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.373744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:29.419301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01ea6d-52d2-4545-87c3-6e972b7ac033 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.452752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570a55c-4837-465b-becc-07feb4b76aa6 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.459288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.459935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.460211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.460477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.470253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.471786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:29.485881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:29.487058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 08:23:29.488061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:29.491763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 261/522] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:29.492616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.495477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.496319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.496656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.496978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.498366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:29.498366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.499514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.517964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 262/523] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:29.518815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.568336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:29.611307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064396b-76f6-49ad-a219-0ac52a7bbd07 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.623327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485cda-3cb5-4299-8841-f3ca029ba91c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.636967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:29.649047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.649755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.650703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.651040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.651751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:29.652114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.653582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.658898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97412e1-216a-49df-bc81-9e82cb07bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.659567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97412e1-216a-49df-bc81-9e82cb07bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.659913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97412e1-216a-49df-bc81-9e82cb07bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.660240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97412e1-216a-49df-bc81-9e82cb07bbe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.671102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 262/524] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:29.671102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.744380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97412e1-216a-49df-bc81-9e82cb07bbe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.745920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97412e1-216a-49df-bc81-9e82cb07bbe7 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.778941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceac37-e74a-47f7-a0c2-567ff9a4b851 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.793096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:29.815002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.815765 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.816148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.816540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:29.817405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:29.817804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:29.819405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:29.837671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 263/525] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Aug 10 08:23:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:29.839158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.860024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 263/526] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:29.860024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97412e1-216a-49df-bc81-9e82cb07bbe7 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:29.891009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:29.959289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d1681-e642-4360-b39d-bfff8c4f77a9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.963564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97412e1-216a-49df-bc81-9e82cb07bbe7 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:29.996981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:29.997604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:29.997876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:29.998143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.002057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:30.002854 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:30.003291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:30.003930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.004807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.005105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=74d6165eeb524d18aa963f3dcaf84dd4) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:30.005555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.006239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.007505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.014422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 264/527] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:29 2022] GET /identity/v3/role_assignments?user.id=74d6165eeb524d18aa963f3dcaf84dd4&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:30.015389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:30.017699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:30.018605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:30.019431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:30.019431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:30.019431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:30.019431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:30.019431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:30.019431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:30.019431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:30.019431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:30.023628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 264/528] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:30.024469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:30.036894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:30.147341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdf879-8642-44c5-bb0c-44dda3fa104f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:30.171935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f2782-b47c-4d8b-920c-7c566236b085 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:30.180623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:30.187955 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:30.188585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:30.188861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:30.189131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.200791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.202173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.213630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c6b4-bffb-4585-9397-e43b4a862531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:30.214544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c6b4-bffb-4585-9397-e43b4a862531 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:30.215002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c6b4-bffb-4585-9397-e43b4a862531 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:30.215451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c6b4-bffb-4585-9397-e43b4a862531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:30.217217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:30.218107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:30.219044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:30.219044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:30.219044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:30.222894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 265/529] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:30.223748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:30.288084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:30.304559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877c6b4-bffb-4585-9397-e43b4a862531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.307299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877c6b4-bffb-4585-9397-e43b4a862531 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.334265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dab45-7221-4f28-8604-a04d2c81c84f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:30.371005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:30.371600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:30.371876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:30.372312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.373012 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:30.373315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.375024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.392280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 266/530] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:30.393589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:30.431995 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 265/531] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:30.432683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c6b4-bffb-4585-9397-e43b4a862531 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:30.446207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:30.520537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2317-b252-4275-8a0d-9df3fe2eeca5 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:30.539587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:30.558446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:30.559290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:30.559570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:30.559838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.560800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:30.561112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.562769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.567470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c6b4-bffb-4585-9397-e43b4a862531 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:30.582633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 267/532] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:30.583782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:30.615571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:30.616884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:30.617447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:30.617924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.619356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=fb458a6186814aadb4ef178ff199582c) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:30.619972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.621860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.629180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 266/533] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/role_assignments?user.id=fb458a6186814aadb4ef178ff199582c&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:30.630159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:30.766281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25a82c-9008-4122-b17d-4974c1b3fa83 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:30.779130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:30.832287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:30.832491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7c77e-8b89-402a-a913-29e2444e7228 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:30.833344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:30.833808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:30.834382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.848461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.850578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.868366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:30.869639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:30.869983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:30.870897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:30.871724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:30.871724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:30.871724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:30.871895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:30.871895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:30.873617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 268/534] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:30.879021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:30.895286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:30.896767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:30.912060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:30.932703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:30.933620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:30.934496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 267/535] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:30.942503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:31.020606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a6f30-2414-4dfc-8b84-4528bdbd916f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:31.084106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba24bd-ccba-4988-ad88-928ac3d854a5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:31.104569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:31.105548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:31.106030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:31.106547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:31.107401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:31.107904 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:31.109483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:31.115519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:31.126867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:31.130151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:31.130151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:31.130151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:31.130151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:31.130151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:31.130531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:31.138424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 269/536] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:31.145105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:31.171927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 268/537] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:31.177753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:31.330287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cdad5-6ec3-4b4c-af16-c52b95d1bf8e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:31.333825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:31.351684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb21d-1e3a-4933-a930-ae3b787e73d6 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:31.371602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:31.372208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:31.372485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:31.372755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:31.373484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=44743b0d10ae4b54920c821e1ef587b5) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:31.373788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:31.375299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:31.382057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 269/538] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:31 2022] GET /identity/v3/role_assignments?user.id=44743b0d10ae4b54920c821e1ef587b5&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:31.417156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a5db4-6874-42c7-a1cd-840250c413f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:31.417822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5db4-6874-42c7-a1cd-840250c413f3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:31.418158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5db4-6874-42c7-a1cd-840250c413f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:31.418431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5db4-6874-42c7-a1cd-840250c413f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:31.426665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a5db4-6874-42c7-a1cd-840250c413f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:31.428214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a5db4-6874-42c7-a1cd-840250c413f3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-d51a5db4-6874-42c7-a1cd-840250c413f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:31.444408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:31.445330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:31.447879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 270/539] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:31.451719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:31.511284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02c0f0-8a2d-44bb-aabe-8d9e4dee5354 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:31.511664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02c0f0-8a2d-44bb-aabe-8d9e4dee5354 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:31.511823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02c0f0-8a2d-44bb-aabe-8d9e4dee5354 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:31.514310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 271/540] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:23:31.519524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d904-a99f-43e8-8c7c-cda227d48d10 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:31.520148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d904-a99f-43e8-8c7c-cda227d48d10 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:31.520635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d904-a99f-43e8-8c7c-cda227d48d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:31.541275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:31.542563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-5a67d904-a99f-43e8-8c7c-cda227d48d10 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:31.543988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5a67d904-a99f-43e8-8c7c-cda227d48d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:31.606646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df3ddf-2817-4fa2-80fd-efa2448079ad None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:31.645405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:31.646378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:31.646903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:31.647373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:31.648493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:31.649015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:31.651744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:31.665303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 270/541] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:31.667861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 272/542] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:31.673282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:31.751290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d904-a99f-43e8-8c7c-cda227d48d10 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:31.800168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227ece-e12c-4a0e-b110-77df281353e0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:31.834971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:31.836794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:31.838163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:31.838683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:31.839174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:31.840129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=80c8c0985f6847368c4f7263b2bf8e43) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:31.840833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:31.842501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:31.848636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 271/543] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:31 2022] GET /identity/v3/role_assignments?user.id=80c8c0985f6847368c4f7263b2bf8e43&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:31.914994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:31.940462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d904-a99f-43e8-8c7c-cda227d48d10 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:32.006147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64add72-feed-4ddd-a674-34cab2485bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:32.007259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64add72-feed-4ddd-a674-34cab2485bdf None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:32.007835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64add72-feed-4ddd-a674-34cab2485bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:32.008306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64add72-feed-4ddd-a674-34cab2485bdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:32.028408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64add72-feed-4ddd-a674-34cab2485bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-d64add72-feed-4ddd-a674-34cab2485bdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:32.033702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:32.034694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:32.035484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:32.037981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 273/544] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:32.044170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:32.178147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42ee6-f516-4162-99c0-349666beb373 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:32.222147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec68d4-cd04-4642-b7d3-44c81d5f5833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:32.222773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec68d4-cd04-4642-b7d3-44c81d5f5833 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:32.223048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec68d4-cd04-4642-b7d3-44c81d5f5833 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:32.223314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec68d4-cd04-4642-b7d3-44c81d5f5833 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:32.223970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec68d4-cd04-4642-b7d3-44c81d5f5833 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:32.224262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec68d4-cd04-4642-b7d3-44c81d5f5833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:32.225605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec68d4-cd04-4642-b7d3-44c81d5f5833 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:32.237959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 272/545] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:32.243235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64add72-feed-4ddd-a674-34cab2485bdf None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:32.299132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b41779-843f-481d-8479-7bd47f52fdb9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:32.299449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b41779-843f-481d-8479-7bd47f52fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:32.299676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b41779-843f-481d-8479-7bd47f52fdb9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:32.301243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 273/546] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:32.307617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598eb07-6f34-476b-8130-f98e618e0712 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:32.307893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598eb07-6f34-476b-8130-f98e618e0712 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:32.308163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598eb07-6f34-476b-8130-f98e618e0712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:32.328249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7598eb07-6f34-476b-8130-f98e618e0712 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:32.329715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7598eb07-6f34-476b-8130-f98e618e0712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:32.386719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:32.427970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64add72-feed-4ddd-a674-34cab2485bdf None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:32.464207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:32.464667 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 274/547] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:32.464789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:32.465026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:32.465260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:32.481510 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:32.487236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:32.488707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:32.502571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598eb07-6f34-476b-8130-f98e618e0712 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:32.505738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:32.506645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:32.508163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:32.508163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:32.508163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:32.508163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 274/548] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:32.513984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:32.631698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc75c1-b879-49e0-837e-f61605e26f19 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:32.684515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:32.685275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:32.685562 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:32.685837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:32.686514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:32.686830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:32.688201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:32.702834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 275/549] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:32.708778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:32.753559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598eb07-6f34-476b-8130-f98e618e0712 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:32.786323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:32.813425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85608a0b-42fd-4608-84c4-72c150ef6c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:32.814071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608a0b-42fd-4608-84c4-72c150ef6c00 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:32.814344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608a0b-42fd-4608-84c4-72c150ef6c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:32.814636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608a0b-42fd-4608-84c4-72c150ef6c00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:32.843865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85608a0b-42fd-4608-84c4-72c150ef6c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-85608a0b-42fd-4608-84c4-72c150ef6c00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:32.853139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:32.854244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:32.855434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 275/550] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:32.859206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdad7d-bdd1-479f-8b5b-04ceda2e2f84 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:32.861138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85608a0b-42fd-4608-84c4-72c150ef6c00 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:32.921269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:32.924341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:32.924978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:32.925257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:32.925529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:32.944550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:32.946338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:32.968657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:32.969785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:32.971227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:32.974223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 276/551] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:32.975274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.053115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85608a0b-42fd-4608-84c4-72c150ef6c00 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.091232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b4352-78d4-4b2d-af70-6e810d71c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:33.091885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b4352-78d4-4b2d-af70-6e810d71c977 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.092165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b4352-78d4-4b2d-af70-6e810d71c977 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.092492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b4352-78d4-4b2d-af70-6e810d71c977 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.093160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b4352-78d4-4b2d-af70-6e810d71c977 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:33.093460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b4352-78d4-4b2d-af70-6e810d71c977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:33.094923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b4352-78d4-4b2d-af70-6e810d71c977 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:33.103521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 276/552] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:33.104742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee636-138b-43d3-b26b-f73a6f689983 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.105026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee636-138b-43d3-b26b-f73a6f689983 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.105300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee636-138b-43d3-b26b-f73a6f689983 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.110495 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 277/553] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:33.110495 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbee636-138b-43d3-b26b-f73a6f689983 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.131040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dc179-b3e7-4512-9f34-51b9faa7dd1c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.148944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:33.170848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40788321-1bff-4944-b4f3-6a9ded960d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:33.171628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40788321-1bff-4944-b4f3-6a9ded960d44 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.171991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40788321-1bff-4944-b4f3-6a9ded960d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.172418 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40788321-1bff-4944-b4f3-6a9ded960d44 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.173275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40788321-1bff-4944-b4f3-6a9ded960d44 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:33.173644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40788321-1bff-4944-b4f3-6a9ded960d44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:33.175282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40788321-1bff-4944-b4f3-6a9ded960d44 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:33.210841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:33.221746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 277/554] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 10 08:23:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:33.221746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8de7a-2bc9-42ca-9cd0-535fb2869504 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.221746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8de7a-2bc9-42ca-9cd0-535fb2869504 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.221746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8de7a-2bc9-42ca-9cd0-535fb2869504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.226351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbee636-138b-43d3-b26b-f73a6f689983 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.264310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:33.265278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.265763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.266225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.269259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-0ef8de7a-2bc9-42ca-9cd0-535fb2869504 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:33.271160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0ef8de7a-2bc9-42ca-9cd0-535fb2869504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:33.279624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:33.281527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:33.298635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:33.299586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:33.300452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:33.300452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:33.300452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:33.302684 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 278/555] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:33.303725 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.354128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 278/556] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:33.355331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8de7a-2bc9-42ca-9cd0-535fb2869504 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.436169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dde72-e16e-431e-a1a8-a9d316cbcf3f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.457478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:33.461587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8de7a-2bc9-42ca-9cd0-535fb2869504 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.479802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef950ca1-3e6d-4d28-8b04-cd48e7a28544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:33.480700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950ca1-3e6d-4d28-8b04-cd48e7a28544 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.480982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950ca1-3e6d-4d28-8b04-cd48e7a28544 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.481255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950ca1-3e6d-4d28-8b04-cd48e7a28544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.499529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:33.500405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:33.501293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.501768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.502236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.503145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:33.503690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:33.505312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:33.517774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 279/557] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:33.518956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.578086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef950ca1-3e6d-4d28-8b04-cd48e7a28544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:33.579830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef950ca1-3e6d-4d28-8b04-cd48e7a28544 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:33.629186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7824c-9c60-4bdb-bac1-d5e4e7530c48 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.671019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888817ef-1b22-489a-bfac-13c85fbf134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:33.671650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888817ef-1b22-489a-bfac-13c85fbf134a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.671929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888817ef-1b22-489a-bfac-13c85fbf134a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.672196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888817ef-1b22-489a-bfac-13c85fbf134a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.686407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888817ef-1b22-489a-bfac-13c85fbf134a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-888817ef-1b22-489a-bfac-13c85fbf134a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:33.693085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:33.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 280/558] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:33.695623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888817ef-1b22-489a-bfac-13c85fbf134a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.707256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 279/559] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:33.708379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef950ca1-3e6d-4d28-8b04-cd48e7a28544 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.719913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:33.755599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:33.800010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888817ef-1b22-489a-bfac-13c85fbf134a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.815855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef950ca1-3e6d-4d28-8b04-cd48e7a28544 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.834957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6070155-b73c-4621-ad3c-3a8f15c5e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:33.835506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070155-b73c-4621-ad3c-3a8f15c5e392 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.835784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070155-b73c-4621-ad3c-3a8f15c5e392 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.836053 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070155-b73c-4621-ad3c-3a8f15c5e392 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.843767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6070155-b73c-4621-ad3c-3a8f15c5e392 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:33.845311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6070155-b73c-4621-ad3c-3a8f15c5e392 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:33.850830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:33.851433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.851715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.851984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.852695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:33.853065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:33.854932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-d6070155-b73c-4621-ad3c-3a8f15c5e392 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:33.857892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:33.858813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:33.859739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 281/560] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:23:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:33.860821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efce4-7983-4a1c-950e-1a858f390b67 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:33.860821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efce4-7983-4a1c-950e-1a858f390b67 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:33.861002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efce4-7983-4a1c-950e-1a858f390b67 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:33.862349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 282/561] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:33.867021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6efce4-7983-4a1c-950e-1a858f390b67 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.872374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 280/562] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:33.873349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:33.957959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:33.981668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6efce4-7983-4a1c-950e-1a858f390b67 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.986000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123d977-6204-4a08-946a-d92e3d5f3047 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:33.993240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.017081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.017701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.017979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.018250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.019586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daaa25e-0240-4758-80a6-7d3ca49d036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.020188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa25e-0240-4758-80a6-7d3ca49d036c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.020465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa25e-0240-4758-80a6-7d3ca49d036c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.020747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa25e-0240-4758-80a6-7d3ca49d036c None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.021472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaa25e-0240-4758-80a6-7d3ca49d036c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:34.021778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaa25e-0240-4758-80a6-7d3ca49d036c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.023237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaa25e-0240-4758-80a6-7d3ca49d036c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.028654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.030096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.046608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 281/563] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:23:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:34.046608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21efd18-25bd-4ce3-aded-908f7123af44 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.046608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21efd18-25bd-4ce3-aded-908f7123af44 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.046608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21efd18-25bd-4ce3-aded-908f7123af44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:34.047005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:34.047848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:34.048708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:34.048708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:34.048708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:34.051918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 283/564] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:34.051918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.062853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f21efd18-25bd-4ce3-aded-908f7123af44 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:34.064172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f21efd18-25bd-4ce3-aded-908f7123af44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:34.135103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 282/565] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:34.135871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21efd18-25bd-4ce3-aded-908f7123af44 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.170963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da333af7-0645-4dc7-a015-4460e973e467 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.204230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.209751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.210370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.210671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.210940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.221971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.223459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:34.237536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:34.238674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:34.239567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:34.239567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:34.239567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:34.239567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 284/566] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:34.239567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.240304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.248464 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21efd18-25bd-4ce3-aded-908f7123af44 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.282109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.282766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.283042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.283313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.293228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.294713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:34.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:34.314370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:34.315707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:34.315707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:34.315707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:34.315707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 283/567] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:34.315707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.339219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b87ac-197a-4700-bdcd-b80f78dacd84 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.372380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9ec6b-8671-4919-b71e-d104930b5cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.372999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ec6b-8671-4919-b71e-d104930b5cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.373271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ec6b-8671-4919-b71e-d104930b5cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.373537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ec6b-8671-4919-b71e-d104930b5cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.374171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9ec6b-8671-4919-b71e-d104930b5cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:34.374485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9ec6b-8671-4919-b71e-d104930b5cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.375848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9ec6b-8671-4919-b71e-d104930b5cc5 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.388345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 285/568] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:34.389425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ea11d-7c7b-4c39-8895-6be74147d30b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.389704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ea11d-7c7b-4c39-8895-6be74147d30b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.389972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ea11d-7c7b-4c39-8895-6be74147d30b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.394534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 286/569] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:34.394534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ea11d-7c7b-4c39-8895-6be74147d30b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.418421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b009-d084-49d7-a430-a29cb5e801d7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.440138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.452052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279a7c1-c51e-4739-9c87-12dda4bd9446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.452677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279a7c1-c51e-4739-9c87-12dda4bd9446 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.452952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279a7c1-c51e-4739-9c87-12dda4bd9446 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.455257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279a7c1-c51e-4739-9c87-12dda4bd9446 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.464862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279a7c1-c51e-4739-9c87-12dda4bd9446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1279a7c1-c51e-4739-9c87-12dda4bd9446 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:34.469892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:34.470874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 284/570] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:34.471757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279a7c1-c51e-4739-9c87-12dda4bd9446 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.480378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.498197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ea11d-7c7b-4c39-8895-6be74147d30b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.532305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.532901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.533174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.533468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.534130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:34.534429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.535821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.546702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 287/571] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:34.547490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.573628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279a7c1-c51e-4739-9c87-12dda4bd9446 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.606278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06854afa-d102-4b8d-987f-8930738906d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.606910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854afa-d102-4b8d-987f-8930738906d4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.607182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854afa-d102-4b8d-987f-8930738906d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.607451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854afa-d102-4b8d-987f-8930738906d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.608091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06854afa-d102-4b8d-987f-8930738906d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:34.608390 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06854afa-d102-4b8d-987f-8930738906d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.609761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06854afa-d102-4b8d-987f-8930738906d4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.621102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 285/572] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:34.622230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1eaf2-7a6c-4452-bdaa-dd4902f5d305 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.622540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1eaf2-7a6c-4452-bdaa-dd4902f5d305 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.622818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1eaf2-7a6c-4452-bdaa-dd4902f5d305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.640115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-05f1eaf2-7a6c-4452-bdaa-dd4902f5d305 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:34.641240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-05f1eaf2-7a6c-4452-bdaa-dd4902f5d305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:34.645114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb992ff8-73dc-4cac-b8f8-f78102489806 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.647374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.678305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.678951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.679227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.679496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.687471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.689635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.700489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:34.701533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:34.702437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:34.703369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:34.703369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:34.703369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:34.703369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:34.703369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:34.703369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:34.703369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:34.703369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:34.704362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 288/573] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:34.705323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.707895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 286/574] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:34.708705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1eaf2-7a6c-4452-bdaa-dd4902f5d305 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.804475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33182e-7b62-43ae-aabf-a6efa8c58280 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.813893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1eaf2-7a6c-4452-bdaa-dd4902f5d305 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.838298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.838916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.839194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.839462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.840127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:34.840426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.841778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.847844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.848463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.848741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.849013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.849371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 289/575] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:34.850145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.860480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.861910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:34.873530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:34.874597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:34.875547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 287/576] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:34.876122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:34.882044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.933840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:34.953658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2199ac-4cce-4553-a7eb-69250527290c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.977709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18962ba3-26e3-47a5-9854-1ff939f90dcd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:34.986315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:34.987060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:34.987334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:34.987600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:34.994945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:34.996365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:35.007271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:35.008309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 290/577] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:35.009272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.013391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.013992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.014270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.014568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.015260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:35.015560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.016981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.029168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 288/578] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:35.029802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.092081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:35.106219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db13db-b21b-494e-8b8f-19bcaf30ca20 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.127588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05925-5f3c-43c7-9851-248f6a6e9fba None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.138939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6babd1-7717-46b9-a30f-0b32bf7b0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.139557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6babd1-7717-46b9-a30f-0b32bf7b0d0d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.139830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6babd1-7717-46b9-a30f-0b32bf7b0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.140104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6babd1-7717-46b9-a30f-0b32bf7b0d0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.143879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:35.149915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6babd1-7717-46b9-a30f-0b32bf7b0d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-4e6babd1-7717-46b9-a30f-0b32bf7b0d0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:35.155432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:35.156538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:35.157515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 291/579] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:35.159312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6babd1-7717-46b9-a30f-0b32bf7b0d0d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.161588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.162215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.162508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.162780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.173182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.174650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:35.189109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:35.190200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:35.191485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:35.191485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:35.191485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:35.191485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 289/580] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:35.191485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.279676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6babd1-7717-46b9-a30f-0b32bf7b0d0d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.313445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.313948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d811cc-f0f8-4a78-97c5-14ff8c85865e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.314365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.314365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.314550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.315271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:35.315571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.316992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.334107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 292/581] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:35.334916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.338135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:35.352270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.352868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.353171 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.353443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.354125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:35.354647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.355855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.367067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 290/582] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:35.367685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.395417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:35.437628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d12bb-e79d-48ba-9c63-8e63918cadcf None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.464598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002608-bad2-4abf-9d95-60b7583614cf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.470611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.471199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.471473 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.471739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.472460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=d3dd402dbe75410aa87c433cbde181c3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:35.472763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.474172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.479348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 293/583] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/role_assignments?user.id=d3dd402dbe75410aa87c433cbde181c3&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:35.494781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.500235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.500858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.501138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.501408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.502087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:35.502390 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.503863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.513914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 291/584] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:35.514823 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.563817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:35.602193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8cae4-53bc-4dec-9952-da8d573b3755 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.612441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:35.624510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c080-4e35-433e-bcd3-9c8e42a63b42 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.642918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.643559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.643834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.644158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.644801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:35.645098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.646887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.659829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 294/585] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:35.660620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.676347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.676976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.677248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.677517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.689143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.690622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:35.705935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:35.706957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:35.707886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:35.707886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:35.707886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:35.711556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 292/586] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:35.712158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.771912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9c82-e6e6-4ea6-b8d7-72e5546ea369 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.800548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:35.808790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da155dc-7f4a-4a84-ac4c-a8750b764fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.809443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da155dc-7f4a-4a84-ac4c-a8750b764fcc None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.809720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da155dc-7f4a-4a84-ac4c-a8750b764fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.810151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da155dc-7f4a-4a84-ac4c-a8750b764fcc None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/74d6165eeb524d18aa963f3dcaf84dd4/roles/2d8d67bb4f814a2da8c49bd7f01cf98e` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.816578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd957f-c783-4361-a00e-d81cf3525496 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:35.824782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da155dc-7f4a-4a84-ac4c-a8750b764fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=74d6165eeb524d18aa963f3dcaf84dd4, role_id=2d8d67bb4f814a2da8c49bd7f01cf98e)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.826274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da155dc-7f4a-4a84-ac4c-a8750b764fcc None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.850295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:35.850945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:35.851217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:35.851484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:35.862324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:35.865871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:35.865871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:35.878798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:35.879915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:35.880805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:35.880805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:35.880805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:35.880805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 293/587] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:35.881123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:35.902815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 295/588] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:23:35 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/74d6165eeb524d18aa963f3dcaf84dd4/roles/2d8d67bb4f814a2da8c49bd7f01cf98e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:35.902815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da155dc-7f4a-4a84-ac4c-a8750b764fcc None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.028970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff91d1-4a62-4071-91ef-2276ad944208 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.065166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da155dc-7f4a-4a84-ac4c-a8750b764fcc None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.068809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.069441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.069716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.069983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.078856 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.080310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:36.092821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:36.093777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:36.094787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 294/589] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:36.099380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.106232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.106869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.107145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.107413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.108052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:36.108358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.109727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.123720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 296/590] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:36.126629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.162971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:36.176302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:36.210429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b419-aab5-4413-9586-dde591cbbf7b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.244074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86206466-8885-4597-8842-1473a37b8fd9 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.247412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.248181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.248604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.249096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.249904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:36.250420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.251966 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.264431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 295/591] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:36.265519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.328656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.329457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.329839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.330204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.331132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:36.331536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.333272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.352497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 297/592] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:36.357459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.373099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02719532-ab5c-417a-9118-acf0016db1e7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.388028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:36.408846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.409773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.410261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.410744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.418576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.420316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:36.431800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:36.432698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:36.433588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:36.433588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:36.433588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:36.433588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:36.433588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:36.433588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:36.433588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:36.433588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:36.435963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 296/593] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:36.437007 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.461296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:36.468320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5aba-a662-44f1-8fee-831cd324b5ed None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.504162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.504816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.505090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.505364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.513299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.514893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:36.527352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:36.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 08:23:36.529315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:36.533271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 298/594] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:36.534281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.546480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54bc45-cbdb-47e8-b5fe-a0f6e262b61c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.583459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.584527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.585001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.585514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.601666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.603575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:36.618713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:36.619705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:36.620623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:36.620623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:36.620623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:36.626926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 297/595] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:36.627998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.651482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a0e35-0c61-42d8-8200-f98faf08bdae None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.666889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:36.694873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.697113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.697605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.698256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.699112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:36.699683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.702123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.717974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 299/596] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:36.719246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.741188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:36.752699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a0b1-33ab-4040-b573-1de5c52b3d96 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.795848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.796774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.797115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.797493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.798843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:36.799349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.801011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.824992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 298/597] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:36.826263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.844270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236a41-4b53-428a-8e20-77f1ad72ccdd None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:36.887953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:36.889064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:36.889808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:36.890256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:36.891108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:36.891662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:36.893703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:36.915655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 300/598] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:36.915655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:36.935657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:36.965661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b80f-d046-4535-a68a-5766a853178c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.004752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78100a66-ba04-4185-965b-18b4b574b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:37.005418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78100a66-ba04-4185-965b-18b4b574b4a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.006102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78100a66-ba04-4185-965b-18b4b574b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.006377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78100a66-ba04-4185-965b-18b4b574b4a5 None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/fb458a6186814aadb4ef178ff199582c/roles/2d8d67bb4f814a2da8c49bd7f01cf98e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.007933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:37.025673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78100a66-ba04-4185-965b-18b4b574b4a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=fb458a6186814aadb4ef178ff199582c, role_id=2d8d67bb4f814a2da8c49bd7f01cf98e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:37.027657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78100a66-ba04-4185-965b-18b4b574b4a5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:37.033323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afd39c-754b-419c-b52c-17def7e4140f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.071753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:37.072862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.073135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.073398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.084673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:37.086211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:37.106578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:37.107782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:37.108918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:37.108918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:37.108918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:37.108918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 301/599] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:37.108918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:37.137478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 299/600] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:23:36 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/fb458a6186814aadb4ef178ff199582c/roles/2d8d67bb4f814a2da8c49bd7f01cf98e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:37.139475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78100a66-ba04-4185-965b-18b4b574b4a5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:37.307011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78100a66-ba04-4185-965b-18b4b574b4a5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.339310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0ce2e-8780-42c8-8441-19b92ffce165 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.348007 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:37.348686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.348959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.349227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.349873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:37.350169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:37.352060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:37.355231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:37.368229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 300/601] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:37.376244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:37.377891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:37.388322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:37.390349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.390349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.390349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.399583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:37.401457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:37.418357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:37.419405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:37.420315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:37.420315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:37.420315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:37.420315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:37.420315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:37.420315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:37.420315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:37.420315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:37.423068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 302/602] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:37.428739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:37.519612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15483609-edda-4875-b36d-8d3bb4065fe3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.556679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa0ea9-0590-4c79-b90a-53380f3591d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:37.557315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0ea9-0590-4c79-b90a-53380f3591d3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.557592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0ea9-0590-4c79-b90a-53380f3591d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.557863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0ea9-0590-4c79-b90a-53380f3591d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.565500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa0ea9-0590-4c79-b90a-53380f3591d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:37.566574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0da5d-8800-40a2-9e4c-7d10acfe5cc0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.566977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa0ea9-0590-4c79-b90a-53380f3591d3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-85aa0ea9-0590-4c79-b90a-53380f3591d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:37.579538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:37.580467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:37.581356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 301/603] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:37.582329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18659a48-4cf0-4455-bad6-340a17fa7009 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.586488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18659a48-4cf0-4455-bad6-340a17fa7009 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.586488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18659a48-4cf0-4455-bad6-340a17fa7009 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.589187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 302/604] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:37.590610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea3264-b3e1-4e2b-8fc6-9f33ffaa7fd4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.590904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea3264-b3e1-4e2b-8fc6-9f33ffaa7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.591175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea3264-b3e1-4e2b-8fc6-9f33ffaa7fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.610409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:37.610917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dfea3264-b3e1-4e2b-8fc6-9f33ffaa7fd4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:37.611131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.611291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.611560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.612111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dfea3264-b3e1-4e2b-8fc6-9f33ffaa7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:37.612288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:37.612531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:37.614214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:37.630704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 303/605] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:37.635346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:37.679482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:37.693912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:37.706379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 303/606] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:37.706379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea3264-b3e1-4e2b-8fc6-9f33ffaa7fd4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:37.772420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d2690-1463-4989-806a-c540af535f7d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.812844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:37.813811 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:37.814267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:37.814727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:37.815618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:37.816073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:37.817681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:37.841586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 304/607] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:37.842862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:37.960631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea3264-b3e1-4e2b-8fc6-9f33ffaa7fd4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.970099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbc7aa-ee31-43b5-aed7-8fe38d7b2a67 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:37.981482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:37.997955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069450d-f446-415b-a4ea-1437e0fc8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:37.999720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069450d-f446-415b-a4ea-1437e0fc8452 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.000206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069450d-f446-415b-a4ea-1437e0fc8452 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.000609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069450d-f446-415b-a4ea-1437e0fc8452 None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/44743b0d10ae4b54920c821e1ef587b5/roles/2d8d67bb4f814a2da8c49bd7f01cf98e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.016935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e9da7-93fe-461b-ad1e-f21cadc6cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:38.017263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069450d-f446-415b-a4ea-1437e0fc8452 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=44743b0d10ae4b54920c821e1ef587b5, role_id=2d8d67bb4f814a2da8c49bd7f01cf98e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:38.017583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9da7-93fe-461b-ad1e-f21cadc6cf90 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.017865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9da7-93fe-461b-ad1e-f21cadc6cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.018134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9da7-93fe-461b-ad1e-f21cadc6cf90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.019427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069450d-f446-415b-a4ea-1437e0fc8452 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:38.033616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e9da7-93fe-461b-ad1e-f21cadc6cf90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-c08e9da7-93fe-461b-ad1e-f21cadc6cf90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:38.039596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:38.040583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:38.041495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:38.045615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 305/608] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:38.046488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e9da7-93fe-461b-ad1e-f21cadc6cf90 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:38.111764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 304/609] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:23:37 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/44743b0d10ae4b54920c821e1ef587b5/roles/2d8d67bb4f814a2da8c49bd7f01cf98e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:38.112672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069450d-f446-415b-a4ea-1437e0fc8452 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:38.155101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:38.159883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e9da7-93fe-461b-ad1e-f21cadc6cf90 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:38.211808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4260-4112-4b9a-849a-691c213f5f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:38.213534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4260-4112-4b9a-849a-691c213f5f88 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.214459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4260-4112-4b9a-849a-691c213f5f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.214964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4260-4112-4b9a-849a-691c213f5f88 None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/80c8c0985f6847368c4f7263b2bf8e43/roles/2d8d67bb4f814a2da8c49bd7f01cf98e` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.233791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069450d-f446-415b-a4ea-1437e0fc8452 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:38.236083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d4260-4112-4b9a-849a-691c213f5f88 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=80c8c0985f6847368c4f7263b2bf8e43, role_id=2d8d67bb4f814a2da8c49bd7f01cf98e)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:38.238636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d4260-4112-4b9a-849a-691c213f5f88 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:38.272707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468f36f-9ed5-4370-8d2f-88142e882128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:38.273500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f36f-9ed5-4370-8d2f-88142e882128 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.273836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f36f-9ed5-4370-8d2f-88142e882128 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.274130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468f36f-9ed5-4370-8d2f-88142e882128 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.275532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468f36f-9ed5-4370-8d2f-88142e882128 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:38.275909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468f36f-9ed5-4370-8d2f-88142e882128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:38.277322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468f36f-9ed5-4370-8d2f-88142e882128 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:38.288054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 305/610] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:38.289626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876992ec-afd9-42c0-95d0-1f0ab47a3a5b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.290182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876992ec-afd9-42c0-95d0-1f0ab47a3a5b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.290737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876992ec-afd9-42c0-95d0-1f0ab47a3a5b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.292494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 306/611] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:38.293868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876992ec-afd9-42c0-95d0-1f0ab47a3a5b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:38.316876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 306/612] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:23:38 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/80c8c0985f6847368c4f7263b2bf8e43/roles/2d8d67bb4f814a2da8c49bd7f01cf98e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:38.318501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c51ca-39a8-492f-bba9-3d92881f7d41 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.322970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c51ca-39a8-492f-bba9-3d92881f7d41 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.323340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c51ca-39a8-492f-bba9-3d92881f7d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.354769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-401c51ca-39a8-492f-bba9-3d92881f7d41 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:38.356139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-401c51ca-39a8-492f-bba9-3d92881f7d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:38.398891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:38.439078 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:38.455994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876992ec-afd9-42c0-95d0-1f0ab47a3a5b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:38.510529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 307/613] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:38.521798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:38.522591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.522959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.523321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.534932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:38.535794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c51ca-39a8-492f-bba9-3d92881f7d41 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:38.536621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:38.553019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:38.554190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:38.555380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:38.555380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:38.555380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:38.557288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 307/614] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:38.563139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:38.704640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99babf04-537d-4695-b821-6e12cbbb92c9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:38.706840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c51ca-39a8-492f-bba9-3d92881f7d41 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:38.766092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:38.766807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.768030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.769443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.770201 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:38.771376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:38.773241 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:38.777581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c809b-33aa-445d-9806-cfa3c81eaf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:38.779270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c809b-33aa-445d-9806-cfa3c81eaf8a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:38.779899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c809b-33aa-445d-9806-cfa3c81eaf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:38.780269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c809b-33aa-445d-9806-cfa3c81eaf8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:38.797314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 308/615] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:38.800368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c809b-33aa-445d-9806-cfa3c81eaf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:38.804572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-7b0c809b-33aa-445d-9806-cfa3c81eaf8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:38.807679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:38.808812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:38.809860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:38.813238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 308/616] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:38.818557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c809b-33aa-445d-9806-cfa3c81eaf8a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:38.834440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:38.835015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:38.994661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ec28-0253-4427-9435-9fe7136d5df6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:38.997818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c809b-33aa-445d-9806-cfa3c81eaf8a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:39.064204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.064755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.065031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.065301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.081275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:39.082759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:39.088792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.089392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.089669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.089936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.090630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:39.090928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:39.092271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:39.104250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:39.105223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:39.106159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:39.106727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 309/617] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:39.117496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 309/618] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:39.118513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:39.121688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:39.209182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:39.247649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd432d7-9686-49cd-bbbc-6b63dfd98e0e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:39.287972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.288740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.289017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.289289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.302243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:39.303712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:39.308238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:39.320398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:39.321330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:39.323003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:39.323003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:39.323003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:39.323003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 310/619] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:39.328544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:39.417915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf349f-1fe5-487a-b0b9-fde1839b733e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:39.455087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2842a-64f5-449d-bd0f-f486667eb356 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:39.480681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:39.493950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614e347-13be-44d2-b822-0c95718ab0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.494582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614e347-13be-44d2-b822-0c95718ab0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.494856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614e347-13be-44d2-b822-0c95718ab0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.495145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614e347-13be-44d2-b822-0c95718ab0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.496198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614e347-13be-44d2-b822-0c95718ab0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:39.496495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614e347-13be-44d2-b822-0c95718ab0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:39.497843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614e347-13be-44d2-b822-0c95718ab0c9 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:39.514969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 311/620] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:39.517783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9302-aba9-4def-9d82-aa02eebc2a76 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.518067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9302-aba9-4def-9d82-aa02eebc2a76 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.518336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9302-aba9-4def-9d82-aa02eebc2a76 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.519722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 312/621] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:39.520678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9302-aba9-4def-9d82-aa02eebc2a76 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:39.527191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210b47-1e99-4574-a05c-2b82fd2b4e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.527801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210b47-1e99-4574-a05c-2b82fd2b4e8e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.528084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210b47-1e99-4574-a05c-2b82fd2b4e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.528382 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210b47-1e99-4574-a05c-2b82fd2b4e8e None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.529134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210b47-1e99-4574-a05c-2b82fd2b4e8e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:39.529446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210b47-1e99-4574-a05c-2b82fd2b4e8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:39.531350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210b47-1e99-4574-a05c-2b82fd2b4e8e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:39.549803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 310/622] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 10 08:23:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:39.555193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4533d-677d-4e14-ad96-5cff1d65bc41 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.555488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4533d-677d-4e14-ad96-5cff1d65bc41 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.555767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4533d-677d-4e14-ad96-5cff1d65bc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.574795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d5b4533d-677d-4e14-ad96-5cff1d65bc41 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:39.575914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d5b4533d-677d-4e14-ad96-5cff1d65bc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:39.643993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9302-aba9-4def-9d82-aa02eebc2a76 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:39.645563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 311/623] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:39.646552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4533d-677d-4e14-ad96-5cff1d65bc41 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:39.694058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.694717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.694990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.695512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.705151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:39.706943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:39.710532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:39.719700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:39.727307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 313/624] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:23:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:39.728820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:39.758456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4533d-677d-4e14-ad96-5cff1d65bc41 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:39.775121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:39.795677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.796619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.797040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.797452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.809614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:39.811323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:39.825795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:39.827125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:39.828052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:39.828052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:39.828052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:39.830709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 312/625] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:39.831524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:39.846234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0d33b-45da-405c-b1de-b35684b97bd8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:39.885115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb4ee0-6b82-4f54-aed2-f8df2f79fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.886059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4ee0-6b82-4f54-aed2-f8df2f79fccb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.886597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4ee0-6b82-4f54-aed2-f8df2f79fccb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.887103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4ee0-6b82-4f54-aed2-f8df2f79fccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.898945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb4ee0-6b82-4f54-aed2-f8df2f79fccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-d0fb4ee0-6b82-4f54-aed2-f8df2f79fccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:39.906615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:39.907553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:39.908389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:39.911211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 314/626] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:39.912310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb4ee0-6b82-4f54-aed2-f8df2f79fccb None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:39.937699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c85e71-c88f-4ac0-b017-f54fa9993eb7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:39.949605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:39.976200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:39.976808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:39.977096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:39.977363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:39.978722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:39.979024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:39.980807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.000800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 313/627] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:23:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:40.001707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.034703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb4ee0-6b82-4f54-aed2-f8df2f79fccb None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.036693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:40.074055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.075073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.075598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.076220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.078028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:40.078570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.081952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.096532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 315/628] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:40.097651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.117846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa582-ced3-4219-84f6-95e45106b7e3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.154348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.154981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.155279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.155896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.156264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:40.156556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.157919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.172271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 314/629] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:40.172817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.203575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:40.208103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7dda0-51d1-4810-9e3f-b4d14d546d01 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.244513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249dbae-b53c-452a-bd8f-a06c37b071e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.245510 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249dbae-b53c-452a-bd8f-a06c37b071e7 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.245994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249dbae-b53c-452a-bd8f-a06c37b071e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.246496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249dbae-b53c-452a-bd8f-a06c37b071e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.279923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:40.282269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b456fe-7906-4a4d-973d-103fe6d30061 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.317732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.318105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.318295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.318584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.321148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249dbae-b53c-452a-bd8f-a06c37b071e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.323458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249dbae-b53c-452a-bd8f-a06c37b071e7 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.327003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.327695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:40.341103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:40.342072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 315/630] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:40.343008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.436687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 316/631] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:40.437296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:40.438446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249dbae-b53c-452a-bd8f-a06c37b071e7 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.454664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af0f6-ac58-4dec-a7af-d28c0e41043a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.491277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319485-1351-4f81-ad89-cd312294e1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.491909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319485-1351-4f81-ad89-cd312294e1cf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.492183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319485-1351-4f81-ad89-cd312294e1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.492448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319485-1351-4f81-ad89-cd312294e1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.502932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319485-1351-4f81-ad89-cd312294e1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.503165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:40.504590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319485-1351-4f81-ad89-cd312294e1cf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-04319485-1351-4f81-ad89-cd312294e1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:40.520236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:40.521224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:40.522109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:40.522109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:40.522109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:40.522109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 316/632] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:40.522827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7d86e-b198-4752-bf85-58faef45d98c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.523291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7d86e-b198-4752-bf85-58faef45d98c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.523404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7d86e-b198-4752-bf85-58faef45d98c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.525401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 317/633] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:40.526114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7d86e-b198-4752-bf85-58faef45d98c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.550585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249dbae-b53c-452a-bd8f-a06c37b071e7 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.588167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d035f-0d7e-443d-9253-849edb472c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.588691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d035f-0d7e-443d-9253-849edb472c26 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.588964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d035f-0d7e-443d-9253-849edb472c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.589231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d035f-0d7e-443d-9253-849edb472c26 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.590033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d035f-0d7e-443d-9253-849edb472c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:40.590335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d035f-0d7e-443d-9253-849edb472c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.591945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d035f-0d7e-443d-9253-849edb472c26 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.603801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 317/634] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:40.604960 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183d48-6e91-49e5-a294-80dd3bb5d0a1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.605247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183d48-6e91-49e5-a294-80dd3bb5d0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.605519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183d48-6e91-49e5-a294-80dd3bb5d0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.623801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f9183d48-6e91-49e5-a294-80dd3bb5d0a1 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:40.624984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f9183d48-6e91-49e5-a294-80dd3bb5d0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:40.628432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7d86e-b198-4752-bf85-58faef45d98c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.661315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.661942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.662218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.662510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.670489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:40.672471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.673901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:40.688562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:40.689576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:40.691027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:40.691027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:40.691027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:40.691027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 318/635] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:40.691258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 318/636] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:40.691331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.691715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c371-3553-47c0-b101-c048f33af6d8 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.692004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c371-3553-47c0-b101-c048f33af6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.692270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403c371-3553-47c0-b101-c048f33af6d8 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.695595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 319/637] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:40.695595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c371-3553-47c0-b101-c048f33af6d8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.751390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:40.792129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348862a-fe55-4502-a632-0cf4031b701d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.797477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403c371-3553-47c0-b101-c048f33af6d8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.825355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.825960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.826239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.826541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.827192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:40.827496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.828887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.832230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881fae8-3d0b-43e9-a701-8758d17b45f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.832863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881fae8-3d0b-43e9-a701-8758d17b45f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.833135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881fae8-3d0b-43e9-a701-8758d17b45f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.833403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881fae8-3d0b-43e9-a701-8758d17b45f3 None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/d3dd402dbe75410aa87c433cbde181c3/roles/2d8d67bb4f814a2da8c49bd7f01cf98e` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.840288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 319/638] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:40.841044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:40.851659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881fae8-3d0b-43e9-a701-8758d17b45f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=d3dd402dbe75410aa87c433cbde181c3, role_id=2d8d67bb4f814a2da8c49bd7f01cf98e)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.853159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881fae8-3d0b-43e9-a701-8758d17b45f3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.892285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:40.933772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 320/639] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:23:40 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/d3dd402dbe75410aa87c433cbde181c3/roles/2d8d67bb4f814a2da8c49bd7f01cf98e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:40.935049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1fd05-9318-4d58-ac58-4a68c4eac04e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.935333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1fd05-9318-4d58-ac58-4a68c4eac04e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.935606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1fd05-9318-4d58-ac58-4a68c4eac04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.938415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498915a-9b06-44b5-bb4c-a120ddfa2d31 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:40.968883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9ab1fd05-9318-4d58-ac58-4a68c4eac04e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:40.971068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9ab1fd05-9318-4d58-ac58-4a68c4eac04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:40.981793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:40.982427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:40.982740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:40.983016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:40.983678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:40.983981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:40.985389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:40.999889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 320/640] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:41.000771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.066492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 321/641] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:41.066492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1fd05-9318-4d58-ac58-4a68c4eac04e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.095261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:41.135508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ecd90-18c2-4ed3-9fdb-d7c834d8c197 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.150304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:41.166157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1fd05-9318-4d58-ac58-4a68c4eac04e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.176891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb15b67-20a7-410b-afbb-a1bd370e414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.177930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15b67-20a7-410b-afbb-a1bd370e414c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.178490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15b67-20a7-410b-afbb-a1bd370e414c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.178787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb15b67-20a7-410b-afbb-a1bd370e414c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.194739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb15b67-20a7-410b-afbb-a1bd370e414c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2cb15b67-20a7-410b-afbb-a1bd370e414c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:41.201447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:41.202362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:41.203337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:41.203987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.203987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.203987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.204186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 321/642] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:41.204263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.204333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb15b67-20a7-410b-afbb-a1bd370e414c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.214518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:41.216788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:41.226157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:41.227425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 08:23:41.229105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:41.234505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 322/643] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:41.234505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.316026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb15b67-20a7-410b-afbb-a1bd370e414c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.323638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:41.332545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5907dde-9357-4e22-b3e7-b12d8b3b6fe2 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.351803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.352421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.352766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.353899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.360745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:41.362178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:41.371906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689651d3-3b2a-4e22-9919-8867367ecb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.372596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689651d3-3b2a-4e22-9919-8867367ecb20 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.372880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689651d3-3b2a-4e22-9919-8867367ecb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.373153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689651d3-3b2a-4e22-9919-8867367ecb20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:41.373253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:41.374064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 322/644] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:41.375536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.389271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689651d3-3b2a-4e22-9919-8867367ecb20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-689651d3-3b2a-4e22-9919-8867367ecb20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:41.394918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:41.395893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:41.396738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:41.398980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 323/645] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:41.400632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689651d3-3b2a-4e22-9919-8867367ecb20 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.407537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:41.477458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df08fb3-ccdc-4b6f-b558-942705de856b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.513461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.514068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.514621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.514621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.515294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:41.515697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:41.516957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:41.517854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689651d3-3b2a-4e22-9919-8867367ecb20 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.531108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 323/646] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:41.531108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.554095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.554848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.555193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.555530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.556371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:41.556734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:41.558221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:41.580519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 324/647] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:41.580519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.589164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:41.638403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:41.645888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d5c82-4cac-4da5-9a5f-b8ce60653c9b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.682094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.682826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.683180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.683526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.684291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:41.684669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:41.685444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505cfc5-1ac3-41da-b175-cb85d31d2bcd None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.686243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:41.698698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 324/648] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:41.699561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.726486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.727183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.727516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.727877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.728596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:41.728953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:41.730393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:41.742565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 325/649] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:41.742565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.803762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb21117-49ab-42d8-a38d-c05354e44a47 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.814599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:41.839938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.840798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.841414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.842416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.847171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067449c5-3572-46e6-83ab-8472ca67d8b7 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:41.853832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:41.855597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:41.870793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:41.871904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:41.872998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:41.872998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:41.872998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:41.876664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 325/650] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:41.877412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:41.884596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346446b-0850-437c-825b-c0422f10c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:41.885201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346446b-0850-437c-825b-c0422f10c849 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:41.885481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346446b-0850-437c-825b-c0422f10c849 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:41.885810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346446b-0850-437c-825b-c0422f10c849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:41.886911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:41.961684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346446b-0850-437c-825b-c0422f10c849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:41.963891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346446b-0850-437c-825b-c0422f10c849 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:41.993805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a29efa-8a6a-4cdf-b612-89c8d7488a97 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.029966 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.030725 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.031084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.031361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.032107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=74d6165eeb524d18aa963f3dcaf84dd4) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:42.032417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.033901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.035275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:42.041195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 326/651] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/role_assignments?user.id=74d6165eeb524d18aa963f3dcaf84dd4&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:42.041971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.086097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 326/652] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:42.087771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346446b-0850-437c-825b-c0422f10c849 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.131669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:42.167010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4405d0e-b34e-4505-8a84-eb15aa2c9597 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.200700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346446b-0850-437c-825b-c0422f10c849 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.204717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.205682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.206164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.206669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.225191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.226836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:42.242902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:42.243905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:42.244808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:42.244808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:42.244808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:42.244808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 327/653] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:42.245031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.249339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.250985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.250985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.250985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.251335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:42.251639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.252996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.267324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 327/654] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:42.268248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.308227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:42.377530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a8e8-b35d-434a-ad89-52900f84df37 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.387957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b07bf-97cd-41f8-abb8-7641f6623ace None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.412948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:42.425807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.426858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.427341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.427895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.428325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.428974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:42.429083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.429279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.429560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.429969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.431777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.443917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.445637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.446381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 328/655] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:42.448023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:42.466174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:42.467271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:42.468166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:42.468166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:42.468166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:42.468166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 328/656] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:42.473201 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.569836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:42.583622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4ec82-3ef6-4c69-beae-d907c8fd5b69 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.588714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cc44f-1649-4f11-b52c-eab84ce65cf3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.624179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.625242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.625740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.626211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.632103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.632739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.633016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.633287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.636475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.638141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.642885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.644338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:42.650491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:42.651985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 08:23:42.652967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:42.653528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 329/657] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:42.658030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:42.658171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:42.659284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 329/658] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:42.660442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.703454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:42.773110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2f557-d85f-40d2-bc44-bd8fba949301 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.800950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20e7a7-37f4-4b7c-ab33-a43d4007ab7d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.810178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.810970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.811344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.811713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.812457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:42.812857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.814321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.831796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 330/659] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:42.832409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.847437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:42.848144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:42.848318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:42.848579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:42.849316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:42.849616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:42.851091 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:42.869765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 330/660] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:42.870671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:42.883184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:42.962795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:42.969913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cc899-18f3-4b12-a52f-d74501703475 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:42.994396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f233751-2a9e-430a-adbe-22c11da6b352 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:43.007224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.008256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.008770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.009635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.010857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:43.011529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:43.013479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:43.029026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4215e-7051-4e0c-98f3-fd6a9b024a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.029590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4215e-7051-4e0c-98f3-fd6a9b024a25 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.029868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4215e-7051-4e0c-98f3-fd6a9b024a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.030147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4215e-7051-4e0c-98f3-fd6a9b024a25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.033876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 331/661] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:43.034871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.036861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4215e-7051-4e0c-98f3-fd6a9b024a25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:43.038407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4215e-7051-4e0c-98f3-fd6a9b024a25 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-a5c4215e-7051-4e0c-98f3-fd6a9b024a25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:43.052320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:43.053262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:43.054217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:43.054217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:43.054217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:43.054217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:43.054217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:43.054217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:43.054217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:43.054217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:43.058158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 331/662] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:43.059496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9292a7-aa7f-4e93-a97d-39e9d590fd32 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.059784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9292a7-aa7f-4e93-a97d-39e9d590fd32 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.060059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9292a7-aa7f-4e93-a97d-39e9d590fd32 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.065167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 332/663] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:43.065167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9292a7-aa7f-4e93-a97d-39e9d590fd32 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.141802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:43.148786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90624b2-0212-436d-bc3b-f5205a276190 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:43.173335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9292a7-aa7f-4e93-a97d-39e9d590fd32 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:43.186426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b9323-ebbd-498f-a447-87901ba8cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.187297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9323-ebbd-498f-a447-87901ba8cf0a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.187576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9323-ebbd-498f-a447-87901ba8cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.187850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9323-ebbd-498f-a447-87901ba8cf0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.210373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:43.211386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba501027-6df6-4ee5-a90d-985ed8e43f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.211979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba501027-6df6-4ee5-a90d-985ed8e43f6f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.212796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba501027-6df6-4ee5-a90d-985ed8e43f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.213065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba501027-6df6-4ee5-a90d-985ed8e43f6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.260668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b9323-ebbd-498f-a447-87901ba8cf0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:43.262220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b9323-ebbd-498f-a447-87901ba8cf0a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:43.289194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba501027-6df6-4ee5-a90d-985ed8e43f6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:43.290582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba501027-6df6-4ee5-a90d-985ed8e43f6f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:43.363984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:43.373411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 332/664] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:43.373411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b9323-ebbd-498f-a447-87901ba8cf0a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.404973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 333/665] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:43.406371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8909-6b96-4414-8035-5fc6909aa31d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.407232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8909-6b96-4414-8035-5fc6909aa31d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.407508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8909-6b96-4414-8035-5fc6909aa31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.424638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a08d8909-6b96-4414-8035-5fc6909aa31d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:43.425838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a08d8909-6b96-4414-8035-5fc6909aa31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:43.430959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:43.482279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b9323-ebbd-498f-a447-87901ba8cf0a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:43.493821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 334/666] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:43.494598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d8909-6b96-4414-8035-5fc6909aa31d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.528266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.528863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.529139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.529405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.530101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:43.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:43.531893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:43.548798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 333/667] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:43.548798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.601388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:43.604987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d8909-6b96-4414-8035-5fc6909aa31d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:43.640936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.641564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.641838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.642104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.643366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce285-ee01-4270-8c9b-3ad2e3ee2098 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:43.652831 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:43.654261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:43.657380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:43.670809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:43.672135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:43.673374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:43.673374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:43.673374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:43.673374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 335/668] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:43.673374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.686056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.687145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.687496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.687766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.699294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:43.700735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:43.714984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:43.716196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:43.717454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:43.717454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:43.717454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:43.720537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 334/669] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:43.721343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.785294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4783c19-d5ba-4a66-86be-15f24cb465eb None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:43.821018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de6ad3-4260-4906-81e0-916f9f187b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.821970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5991e-4612-488f-aea5-f48166145de8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:43.822679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de6ad3-4260-4906-81e0-916f9f187b4e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.823106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de6ad3-4260-4906-81e0-916f9f187b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.823586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de6ad3-4260-4906-81e0-916f9f187b4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.835920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de6ad3-4260-4906-81e0-916f9f187b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-c5de6ad3-4260-4906-81e0-916f9f187b4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:43.841056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:43.842008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 336/670] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:43.843334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de6ad3-4260-4906-81e0-916f9f187b4e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.857611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:43.861066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:43.861677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:43.861956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:43.862226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:43.862979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=fb458a6186814aadb4ef178ff199582c) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:43.863284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:43.864706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:43.878504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 335/671] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/role_assignments?user.id=fb458a6186814aadb4ef178ff199582c&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:43.878504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:43.914417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:43.979825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de6ad3-4260-4906-81e0-916f9f187b4e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.007754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb087bdc-97fc-4ea8-bd29-6365a8f2d3d9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.014159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.014970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.015386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.015773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.016592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:44.016998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.018558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.036613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 337/672] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:44.037724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.049384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.049999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.050271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.050576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.051346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:44.051618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.052985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.067836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 336/673] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:44.068691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.128740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:44.169268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c5dc1-f199-483e-9090-e35d522d5556 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.175191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:44.188990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67344e98-0f5f-4cf8-9729-64bb4dad0279 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.208365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.209058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.209406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.209777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.210548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:44.210925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.212404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.221103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 338/674] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:44.221921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.226524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d2888-4c42-4396-957e-9b5862651136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.227133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2888-4c42-4396-957e-9b5862651136 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.227410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2888-4c42-4396-957e-9b5862651136 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.228207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2888-4c42-4396-957e-9b5862651136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.235229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d2888-4c42-4396-957e-9b5862651136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.236679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d2888-4c42-4396-957e-9b5862651136 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9b9d2888-4c42-4396-957e-9b5862651136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:44.248504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:44.249410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:44.250301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 337/675] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:44.250836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604104-5b62-4363-8acf-040cf03f2621 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.251367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604104-5b62-4363-8acf-040cf03f2621 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.251367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604104-5b62-4363-8acf-040cf03f2621 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.252952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 338/676] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:44.253662 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604104-5b62-4363-8acf-040cf03f2621 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.335896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb4aab-ba55-4c09-a4e1-4d3aacff4647 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.364686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604104-5b62-4363-8acf-040cf03f2621 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.372314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.372942 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.373219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.373488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.376193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:44.380667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.382057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:44.393116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:44.394021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 339/677] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:44.395000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.409498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b514dd-a96c-499a-9d09-a1e772c36e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.410206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b514dd-a96c-499a-9d09-a1e772c36e24 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.410512 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b514dd-a96c-499a-9d09-a1e772c36e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.410819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b514dd-a96c-499a-9d09-a1e772c36e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.422405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b514dd-a96c-499a-9d09-a1e772c36e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.423864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b514dd-a96c-499a-9d09-a1e772c36e24 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.432238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-64b514dd-a96c-499a-9d09-a1e772c36e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:44.438537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:44.443579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:44.444664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:44.444664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:44.444664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:44.444664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 339/678] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:44.444664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5597-9490-4b06-9bfd-f0f7a15e11de None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.444664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5597-9490-4b06-9bfd-f0f7a15e11de None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.444664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba5597-9490-4b06-9bfd-f0f7a15e11de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.462863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-71ba5597-9490-4b06-9bfd-f0f7a15e11de None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:44.464125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-71ba5597-9490-4b06-9bfd-f0f7a15e11de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:44.510218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a325de-0c78-4192-aca4-6d1463eb753c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.536541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 340/679] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:44.537214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5597-9490-4b06-9bfd-f0f7a15e11de None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.550489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.556170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.556170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.556170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.556170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:44.556170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.556170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.566632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 340/680] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:44.567605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.629193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:44.646535 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba5597-9490-4b06-9bfd-f0f7a15e11de None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.676747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860aa53-3f1f-41a3-979a-8385b36fc4a2 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.678733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:44.687772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.688443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.688829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.689042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.689774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:44.690076 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.691545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.703362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 341/681] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:44.704161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.718279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.719210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.719763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.720217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.721043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:44.721550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.723152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.735693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 341/682] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:44.736555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.812547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de10bf-5de6-444e-bced-bbbbd2de5b2d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.837788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bfbe1-bea1-4354-8453-d5d1d99b66e6 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:44.847677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7f78-97be-4c9a-a0c0-ae20503232f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.848373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7f78-97be-4c9a-a0c0-ae20503232f6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.848718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7f78-97be-4c9a-a0c0-ae20503232f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.849053 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7f78-97be-4c9a-a0c0-ae20503232f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.851973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:44.861491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f7f78-97be-4c9a-a0c0-ae20503232f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-522f7f78-97be-4c9a-a0c0-ae20503232f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:44.869507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:44.870825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 342/683] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:44.872059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7f78-97be-4c9a-a0c0-ae20503232f6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.877865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:44.878480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:44.879001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:44.879272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:44.880261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=80c8c0985f6847368c4f7263b2bf8e43) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:44.880585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:44.882011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:44.888264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 342/684] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/role_assignments?user.id=80c8c0985f6847368c4f7263b2bf8e43&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:44.889350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:44.955665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:45.016012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7f78-97be-4c9a-a0c0-ae20503232f6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.028127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d740ab-219b-4d3a-ab5f-36cc5a3a493c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.055396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.057005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.057436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.057799 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.058659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=44743b0d10ae4b54920c821e1ef587b5) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:45.059058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.060580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.067043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 343/685] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/role_assignments?user.id=44743b0d10ae4b54920c821e1ef587b5&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:45.068866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:45.073922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.074849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.075294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.075726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.086582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.089343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:45.105884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:45.107106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:45.108253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:45.111000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 343/686] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:45.116866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:45.167082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:45.221598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c5410-c39e-43cf-84c8-2b1f72989500 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.245857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb91ff-6b10-4b16-bf91-35828f3d9083 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.258893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:45.269380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.275116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.275116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.275116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.275116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:45.275116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.275116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.286249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.286635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 344/687] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:45.287492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.287852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.288185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.288976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:45.289340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.291776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.292452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:45.321439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 344/688] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 10 08:23:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:45.322240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:45.430325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f142550-8a46-4945-8a30-4ada819bd286 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.435951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:45.442734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcc6a0-a211-4a5c-bcbd-026fd84f0400 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.469779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.470728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.471151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.471584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.481154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888fdd5-c7cf-43c7-a16b-6f9d8fe686f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.482068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888fdd5-c7cf-43c7-a16b-6f9d8fe686f0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.482649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888fdd5-c7cf-43c7-a16b-6f9d8fe686f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.482649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888fdd5-c7cf-43c7-a16b-6f9d8fe686f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.484800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.486648 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:45.502838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:45.504013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:45.505117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:45.505117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:45.505117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:45.506861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 345/689] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:45.512941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:45.553025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:45.562513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888fdd5-c7cf-43c7-a16b-6f9d8fe686f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.563859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888fdd5-c7cf-43c7-a16b-6f9d8fe686f0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.650872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eaae6-f371-4c57-a870-36a08bcae04d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.678627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:45.694071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.703806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.703806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.703806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.703806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:45.703806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.704250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 345/690] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:45.704343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.704433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888fdd5-c7cf-43c7-a16b-6f9d8fe686f0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:45.710953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 346/691] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:45.721586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:45.881283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888fdd5-c7cf-43c7-a16b-6f9d8fe686f0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.898833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:45.918498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676a8f-3cfd-40ea-9951-475e66c6d08c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:45.949829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.950543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.950817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.951079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.971936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:45.972628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:45.972906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:45.973223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:45.974946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.976479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.980695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:45.982124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:45.991590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:45.992855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:45.994458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:45.994458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:45.994458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:45.994840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:45.996000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:45.997280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:45.997952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 346/693] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:46.002785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 347/692] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:23:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:46.004886 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.005197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.101065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:46.156780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc599-2e59-468c-bf17-021da4cbc521 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:46.177504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cc5a3-46e8-4c96-a583-1f020dad1edc None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:46.199658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db23c-4749-440a-a2cd-7e25a3f08386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:46.200598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db23c-4749-440a-a2cd-7e25a3f08386 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.200922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db23c-4749-440a-a2cd-7e25a3f08386 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.201199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db23c-4749-440a-a2cd-7e25a3f08386 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.201847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db23c-4749-440a-a2cd-7e25a3f08386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:46.202149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db23c-4749-440a-a2cd-7e25a3f08386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:46.204018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db23c-4749-440a-a2cd-7e25a3f08386 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:46.219381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 348/694] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:46.219572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9009ae-b63e-474e-9679-9c5ef679138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:46.220736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1bc8-1f60-4c9a-aedf-f56a520d2d92 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.221027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1bc8-1f60-4c9a-aedf-f56a520d2d92 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.221299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1bc8-1f60-4c9a-aedf-f56a520d2d92 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.224455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9009ae-b63e-474e-9679-9c5ef679138a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.224810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9009ae-b63e-474e-9679-9c5ef679138a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.225161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9009ae-b63e-474e-9679-9c5ef679138a None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.226008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9009ae-b63e-474e-9679-9c5ef679138a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:46.230648 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9009ae-b63e-474e-9679-9c5ef679138a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:46.230791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 349/695] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:46.230791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e1bc8-1f60-4c9a-aedf-f56a520d2d92 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.230952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9009ae-b63e-474e-9679-9c5ef679138a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:46.244902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:46.254550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 347/696] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:46.256068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d1b6-28ce-449a-99d2-7ed58f267324 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.256543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d1b6-28ce-449a-99d2-7ed58f267324 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.257011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d1b6-28ce-449a-99d2-7ed58f267324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.275421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7634d1b6-28ce-449a-99d2-7ed58f267324 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:46.276913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7634d1b6-28ce-449a-99d2-7ed58f267324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:46.360148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 348/697] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:46.361433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634d1b6-28ce-449a-99d2-7ed58f267324 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.375220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e1bc8-1f60-4c9a-aedf-f56a520d2d92 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:46.414601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:46.416302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.416818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.417317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.418273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:46.425197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:46.427068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:46.440242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:46.441183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:46.442087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:46.442087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:46.442087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:46.442087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:46.442087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:46.442087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:46.442087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:46.442087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:46.444598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 350/698] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:46.450325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.497455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634d1b6-28ce-449a-99d2-7ed58f267324 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:46.521955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:46.542965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304e6e5-60ef-4d62-b8e7-32b8c70026d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:46.544244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304e6e5-60ef-4d62-b8e7-32b8c70026d8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.544942 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304e6e5-60ef-4d62-b8e7-32b8c70026d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.545385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304e6e5-60ef-4d62-b8e7-32b8c70026d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.562239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8e027-53b1-4b41-b8c6-c7194be68c65 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:46.603555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:46.604335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.604706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.605071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.616513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:46.618143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:46.624530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304e6e5-60ef-4d62-b8e7-32b8c70026d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:46.627191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304e6e5-60ef-4d62-b8e7-32b8c70026d8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:46.633018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:46.634199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:46.635358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:46.635358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:46.635358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:46.641177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 351/699] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:46.641177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.681212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:46.749877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b1e7e-f700-4aea-b055-49410673e416 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:46.755063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 349/700] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 08:23:46.756175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304e6e5-60ef-4d62-b8e7-32b8c70026d8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.770772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:46.785769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:46.790705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.790705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.790705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.790705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:46.790705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:46.790705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:46.802900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 352/701] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:46.804013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.867909 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304e6e5-60ef-4d62-b8e7-32b8c70026d8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:46.905128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a7c19-efdb-4ee5-ad70-8fe9a51a5464 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:46.905846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:46.907122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.907675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.908184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.909044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:46.909557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:46.911141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:46.913874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:46.929751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 350/702] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:46.931139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:46.953731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:46.954310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:46.954616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:46.954889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:46.965916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:46.967452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:46.981816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:46.982821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:46.983712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:46.983712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:46.983712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:46.983712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 353/703] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:46.984386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:47.016340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:47.050047 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fe541-51b3-479a-b384-881ffcbeeef4 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:47.086607 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971b4f4-4f82-4916-acce-fab53fbcc4c2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:47.088642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:47.089599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.090106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.090622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.091550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=d3dd402dbe75410aa87c433cbde181c3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:47.092073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:47.093706 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:47.100814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 351/704] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:46 2022] GET /identity/v3/role_assignments?user.id=d3dd402dbe75410aa87c433cbde181c3&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:47.102042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:47.171986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0335f8e-36a0-42e3-8671-0863d61e8e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:47.172614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335f8e-36a0-42e3-8671-0863d61e8e70 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.172886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335f8e-36a0-42e3-8671-0863d61e8e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.173158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335f8e-36a0-42e3-8671-0863d61e8e70 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.173872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0335f8e-36a0-42e3-8671-0863d61e8e70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:47.175377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0335f8e-36a0-42e3-8671-0863d61e8e70 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:47.180706 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:47.233708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf2e0e-6761-43e6-8cd1-0f49ef494e1d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:47.271600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:47.272211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.272491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.272767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.273416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:47.273719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:47.275784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:47.281606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 354/705] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:23:46 2022] POST /identity/v3/users => generated 254 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:47.283880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143a58d-d8b9-4192-9c14-4638eba07aee None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.284414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143a58d-d8b9-4192-9c14-4638eba07aee None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.284900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143a58d-d8b9-4192-9c14-4638eba07aee None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.286887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 355/706] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:47.292976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e38e6-99b7-4b26-bd46-8cb0120f74d9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.293573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e38e6-99b7-4b26-bd46-8cb0120f74d9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.296560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e38e6-99b7-4b26-bd46-8cb0120f74d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.296686 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 352/707] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:47.300702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:47.317419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e56e38e6-99b7-4b26-bd46-8cb0120f74d9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:47.319303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e56e38e6-99b7-4b26-bd46-8cb0120f74d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:47.423298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 356/708] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:47.426555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7a9e-153b-4415-8ec4-0a8ce128cb45 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:47.451829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:47.453154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e38e6-99b7-4b26-bd46-8cb0120f74d9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:47.468383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:47.469023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.469309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.469572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.478353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:47.479017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:47.480603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:47.500625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:47.501738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:47.502897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:47.502897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:47.502897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:47.502897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:47.502897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:47.502897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:47.502897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:47.502897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:47.504986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 353/709] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:47.511460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:47.572229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e38e6-99b7-4b26-bd46-8cb0120f74d9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:47.609626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:47.610278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.611991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.612274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] PATH_INFO: `/v3/services/network` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.612871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:47.614253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:47.626358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:47.627510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:47.628378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 357/710] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:47 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:47.634206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:47.657583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d69c-62fa-441a-9b02-b9f15cc9693f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:47.703059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077274ba-a4cf-4713-bfd3-72a1d680022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:47.703752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077274ba-a4cf-4713-bfd3-72a1d680022c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.704037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077274ba-a4cf-4713-bfd3-72a1d680022c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.704309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077274ba-a4cf-4713-bfd3-72a1d680022c None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.705011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077274ba-a4cf-4713-bfd3-72a1d680022c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:47.705319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077274ba-a4cf-4713-bfd3-72a1d680022c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:47.706768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077274ba-a4cf-4713-bfd3-72a1d680022c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:47.724472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 354/711] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:47.726137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11ce4-0dbf-4af0-bc7d-66207e812ca3 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.726428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11ce4-0dbf-4af0-bc7d-66207e812ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.726774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11ce4-0dbf-4af0-bc7d-66207e812ca3 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.728612 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 355/712] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:47.731273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11ce4-0dbf-4af0-bc7d-66207e812ca3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:47.742084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:47.766888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f090f-1a82-44d6-8e81-3410e04c6b7a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:47.779807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:47.810014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663abc7-2d7e-42ca-9749-db949007d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:47.810673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663abc7-2d7e-42ca-9749-db949007d081 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.810949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663abc7-2d7e-42ca-9749-db949007d081 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.811217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663abc7-2d7e-42ca-9749-db949007d081 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.812012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663abc7-2d7e-42ca-9749-db949007d081 None admin] RBAC: Adding query filter params (name=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:47.812317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663abc7-2d7e-42ca-9749-db949007d081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:47.813722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663abc7-2d7e-42ca-9749-db949007d081 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:47.822498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 358/713] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:23:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:47.822498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb409cdd-5bbc-4aed-bccc-ebc9b6c8205b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.822498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb409cdd-5bbc-4aed-bccc-ebc9b6c8205b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.822498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb409cdd-5bbc-4aed-bccc-ebc9b6c8205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.844087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fb409cdd-5bbc-4aed-bccc-ebc9b6c8205b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:47.845646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fb409cdd-5bbc-4aed-bccc-ebc9b6c8205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:47.855041 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11ce4-0dbf-4af0-bc7d-66207e812ca3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:47.902734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:47.903360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:47.903644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:47.903974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:47.904766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=74d6165eeb524d18aa963f3dcaf84dd4) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:47.905074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:47.907152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:47.914885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 356/714] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:47 2022] GET /identity/v3/role_assignments?user.id=74d6165eeb524d18aa963f3dcaf84dd4&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=45149274288845b0a73e18fbb3394202 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:47.916422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:47.931297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 359/715] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:47.945724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb409cdd-5bbc-4aed-bccc-ebc9b6c8205b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:48.096490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae528c5-8fdf-44b6-a70b-b150d9088a7f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:48.097043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:48.099020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:48.124672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb409cdd-5bbc-4aed-bccc-ebc9b6c8205b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:48.133870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:48.134486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:48.135541 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:48.136600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:48.137243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] RBAC: Adding query filter params (type=network) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:48.137545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:48.139056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:48.150522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 357/716] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:23:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:48.184623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:48.185276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:48.185552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:48.185816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:48.186398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:48.187906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:48.203296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:48.204380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:48.205202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:48.205934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 360/717] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Aug 10 08:23:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:48.210792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:48.341115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8bd51-f6b0-486f-9e27-af12d4605663 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:48.376389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d160d1a-11a1-41a5-8f03-84c8add6ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:48.376918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d160d1a-11a1-41a5-8f03-84c8add6ac9b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:48.377197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d160d1a-11a1-41a5-8f03-84c8add6ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:48.377470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d160d1a-11a1-41a5-8f03-84c8add6ac9b None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:48.378104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d160d1a-11a1-41a5-8f03-84c8add6ac9b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:48.378408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d160d1a-11a1-41a5-8f03-84c8add6ac9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:48.379804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d160d1a-11a1-41a5-8f03-84c8add6ac9b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:48.384346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 358/718] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 10 08:23:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:48.390001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:48.544282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be668ce-74bd-4644-b49a-6152502de0e9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:48.593933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4704e-2c1c-4742-b8e9-2435b6796a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:48.594570 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4704e-2c1c-4742-b8e9-2435b6796a35 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:48.594851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4704e-2c1c-4742-b8e9-2435b6796a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:48.595123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4704e-2c1c-4742-b8e9-2435b6796a35 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:48.595757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4704e-2c1c-4742-b8e9-2435b6796a35 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:48.596058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4704e-2c1c-4742-b8e9-2435b6796a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:48.597428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4704e-2c1c-4742-b8e9-2435b6796a35 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:48.603672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 361/719] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 10 08:23:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:49.903158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4f070-b695-4dd8-a823-38b701f5b235 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:49.903685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4f070-b695-4dd8-a823-38b701f5b235 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:49.903685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4f070-b695-4dd8-a823-38b701f5b235 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:49.905301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 359/720] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:49.910657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65cbb9-4a8e-4806-8ed2-4795b1fe4951 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:49.911495 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65cbb9-4a8e-4806-8ed2-4795b1fe4951 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:49.911971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65cbb9-4a8e-4806-8ed2-4795b1fe4951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:49.923245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:49.934105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6b65cbb9-4a8e-4806-8ed2-4795b1fe4951 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:49.935433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6b65cbb9-4a8e-4806-8ed2-4795b1fe4951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:49.965891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ec06-f528-4198-ba0a-8b1b2f61412d None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:49.966192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ec06-f528-4198-ba0a-8b1b2f61412d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:49.966444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ec06-f528-4198-ba0a-8b1b2f61412d None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:49.968098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 360/721] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:23:49.973020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df76be-aa0d-4a54-bc79-62f401129ff0 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:49.973304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df76be-aa0d-4a54-bc79-62f401129ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:49.973582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df76be-aa0d-4a54-bc79-62f401129ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:49.991993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f0df76be-aa0d-4a54-bc79-62f401129ff0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:49.993246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f0df76be-aa0d-4a54-bc79-62f401129ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:50.021030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:50.044939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 362/722] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:50.074574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 361/723] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 08:23:50.093476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65cbb9-4a8e-4806-8ed2-4795b1fe4951 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:50.098989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df76be-aa0d-4a54-bc79-62f401129ff0 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:50.241278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65cbb9-4a8e-4806-8ed2-4795b1fe4951 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:50.247360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df76be-aa0d-4a54-bc79-62f401129ff0 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:50.285316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186c951-cb38-4900-8a40-9a6d8703bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:50.285949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c951-cb38-4900-8a40-9a6d8703bff1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.286226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c951-cb38-4900-8a40-9a6d8703bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.286514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c951-cb38-4900-8a40-9a6d8703bff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.297011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186c951-cb38-4900-8a40-9a6d8703bff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-a186c951-cb38-4900-8a40-9a6d8703bff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:50.301809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:50.302833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:50.303665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 362/724] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:50.304878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1d4b-3a3e-4f7e-be9b-edc262b5f419 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.305072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1d4b-3a3e-4f7e-be9b-edc262b5f419 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.308328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1d4b-3a3e-4f7e-be9b-edc262b5f419 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.311310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 363/725] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:50.312206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b1d4b-3a3e-4f7e-be9b-edc262b5f419 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:50.332342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d374-b504-4077-8cd4-6a265dbcf1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:50.333010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d374-b504-4077-8cd4-6a265dbcf1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.333291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d374-b504-4077-8cd4-6a265dbcf1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.333569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d374-b504-4077-8cd4-6a265dbcf1d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.335844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:50.346065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885d374-b504-4077-8cd4-6a265dbcf1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9885d374-b504-4077-8cd4-6a265dbcf1d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:50.351344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:50.355549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:50.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 363/726] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:50.360022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bace5-38b0-4e86-b589-8c6ff7296d54 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.360393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bace5-38b0-4e86-b589-8c6ff7296d54 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.360749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bace5-38b0-4e86-b589-8c6ff7296d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.381137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b48bace5-38b0-4e86-b589-8c6ff7296d54 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:50.384281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b48bace5-38b0-4e86-b589-8c6ff7296d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:50.465909 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:50.474487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 364/727] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:50.474487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bace5-38b0-4e86-b589-8c6ff7296d54 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:50.568939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b1d4b-3a3e-4f7e-be9b-edc262b5f419 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:50.595729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bace5-38b0-4e86-b589-8c6ff7296d54 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:50.605468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:50.606447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.606968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.607456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.608419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:50.608959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:50.610716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:50.620478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 364/728] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:50.621701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:50.624915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:50.640035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:50.640994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.641281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.641558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.642508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:50.642853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:50.644523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:50.658635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 365/729] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:50.659482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:50.715495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:50.730946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae9f5-314d-47db-85e0-bc9efb145a2d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:50.766408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ca52f-349b-483b-a42a-5545755738c2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:50.767502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94470a-2593-4791-923a-73df68276e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:50.768232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94470a-2593-4791-923a-73df68276e61 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.768545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94470a-2593-4791-923a-73df68276e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.768812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94470a-2593-4791-923a-73df68276e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.778957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94470a-2593-4791-923a-73df68276e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-fc94470a-2593-4791-923a-73df68276e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:50.783535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:50.784496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 365/730] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:50.786164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3399b-2f15-4a17-9666-f65622230c70 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.787183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3399b-2f15-4a17-9666-f65622230c70 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.787183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3399b-2f15-4a17-9666-f65622230c70 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.787976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 366/731] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:50.791231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3399b-2f15-4a17-9666-f65622230c70 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:50.809308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:50.809972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.810251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.810548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.822384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:50.823788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:50.838221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:50.839321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:50.840224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:50.840224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:50.840224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:50.844000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 366/732] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:50.844836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:50.887516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:50.905149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3399b-2f15-4a17-9666-f65622230c70 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:50.949560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a2335-7776-4706-a536-320d70bb392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:50.950189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2335-7776-4706-a536-320d70bb392a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.950476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2335-7776-4706-a536-320d70bb392a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.950780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2335-7776-4706-a536-320d70bb392a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:50.959783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda97e8-fb40-4b5b-9756-7da653e9fc25 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:50.961207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a2335-7776-4706-a536-320d70bb392a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:50.962684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a2335-7776-4706-a536-320d70bb392a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:50.965486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-e21a2335-7776-4706-a536-320d70bb392a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:50.979095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:50.980083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:50.980977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:50.980977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:50.980977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:50.980977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 367/733] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:50.981638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba0ee0-ca8b-4aac-b92c-9979ab8c0b20 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:50.981882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba0ee0-ca8b-4aac-b92c-9979ab8c0b20 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:50.982148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba0ee0-ca8b-4aac-b92c-9979ab8c0b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.000318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-07ba0ee0-ca8b-4aac-b92c-9979ab8c0b20 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:51.000904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.001486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-07ba0ee0-ca8b-4aac-b92c-9979ab8c0b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:51.001590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.001781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.002054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.002769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:51.003106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.004482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.012807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 367/734] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:51.013602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.089680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 368/735] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:51.094486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba0ee0-ca8b-4aac-b92c-9979ab8c0b20 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.122923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:51.126499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538c430-25ab-4b9a-af19-41c4c6bc399f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.163626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.164230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.164509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.164785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.164785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:51.164785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.167881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.179887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 368/736] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:51.180747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.196680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba0ee0-ca8b-4aac-b92c-9979ab8c0b20 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.221860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:51.231038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.231634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.231910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.232205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.232838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:51.233182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.234553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.245470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 369/737] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:51.246213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.282378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407c95b-906c-49f7-899b-172da2d0e5e0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.314826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a32487-abe0-4a1e-a16a-d7374e77c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.315446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a32487-abe0-4a1e-a16a-d7374e77c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.315731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a32487-abe0-4a1e-a16a-d7374e77c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.315988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a32487-abe0-4a1e-a16a-d7374e77c7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.326459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a32487-abe0-4a1e-a16a-d7374e77c7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.327907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a32487-abe0-4a1e-a16a-d7374e77c7f1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-98a32487-abe0-4a1e-a16a-d7374e77c7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:51.341874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:51.342876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:51.343789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:51.343789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:51.343789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:51.343789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 369/738] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:51.344380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e8819-bbcd-4712-a34e-e537f09d1216 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.344466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e773-f255-4e8f-80ed-0ec70b7f552e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.344466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e773-f255-4e8f-80ed-0ec70b7f552e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.344602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9e773-f255-4e8f-80ed-0ec70b7f552e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.346202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 370/739] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:51.346393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9e773-f255-4e8f-80ed-0ec70b7f552e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.363059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:51.380556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7fb19-6af9-4808-b486-26ca9ad890be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.381159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7fb19-6af9-4808-b486-26ca9ad890be None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.381434 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7fb19-6af9-4808-b486-26ca9ad890be None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.381704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7fb19-6af9-4808-b486-26ca9ad890be None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.382337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7fb19-6af9-4808-b486-26ca9ad890be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.383727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7fb19-6af9-4808-b486-26ca9ad890be None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.449422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9e773-f255-4e8f-80ed-0ec70b7f552e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.478497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 370/740] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:23:51 2022] POST /identity/v3/services => generated 240 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:51.478497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7fb19-6af9-4808-b486-26ca9ad890be None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.497287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.498224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.498588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.498863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.510423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.512784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:51.530774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:51.531866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:51.532822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:51.533385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:51.534281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 371/741] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:51.534763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.605200 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7fb19-6af9-4808-b486-26ca9ad890be None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.611938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:51.643682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275977-d93a-453c-9da8-3192fbfef501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.644305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275977-d93a-453c-9da8-3192fbfef501 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.644584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275977-d93a-453c-9da8-3192fbfef501 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.644852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275977-d93a-453c-9da8-3192fbfef501 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.651632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086bb5e-c93c-4d59-a0ea-182c3eb1033a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.653414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275977-d93a-453c-9da8-3192fbfef501 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.655080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275977-d93a-453c-9da8-3192fbfef501 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-a7275977-d93a-453c-9da8-3192fbfef501 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:51.667870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:51.669051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:51.670049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 371/742] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:51.670864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab10a18-6e73-418e-891d-31340077245a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.671050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab10a18-6e73-418e-891d-31340077245a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.671318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab10a18-6e73-418e-891d-31340077245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.688882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9ab10a18-6e73-418e-891d-31340077245a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:51.690054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9ab10a18-6e73-418e-891d-31340077245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:51.694295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.695280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.695653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.696012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.697307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:51.697696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.699185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.716832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 372/743] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:51.716832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.764187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 372/744] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:51 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 08:23:51.764946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab10a18-6e73-418e-891d-31340077245a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.800658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:51.837499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06041e-8fbc-46a4-927f-c256cb89af56 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.864472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:51.867429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab10a18-6e73-418e-891d-31340077245a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:51.872889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.873489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.881093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.881093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.881093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:51.881093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.881093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.893948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 373/745] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:51.894792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:51.907875 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:51.908479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:51.908754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:51.909029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:51.909761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:51.910063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:51.911518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:51.930128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 373/746] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:51.931512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.009611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f470-2ee7-4056-9b4b-4726b8df8440 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.038163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:52.044700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871eed78-5344-4f2a-ae80-bd3cde3a9181 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.044825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.052689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.052689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.052689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.053082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.054584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:52.066711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:52.067708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 374/747] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:23:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:52.068676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.084293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4d10-4105-4cf4-b9ae-44a16df50689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.084896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4d10-4105-4cf4-b9ae-44a16df50689 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.085174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4d10-4105-4cf4-b9ae-44a16df50689 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.085445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4d10-4105-4cf4-b9ae-44a16df50689 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.086080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa4d10-4105-4cf4-b9ae-44a16df50689 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.087995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa4d10-4105-4cf4-b9ae-44a16df50689 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.116883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:52.168564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c05fc-bdcd-470f-9629-98bd88e3d06e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.210757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 374/748] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:23:51 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:23:52.210757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4d10-4105-4cf4-b9ae-44a16df50689 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.216893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9b080-4dc4-4101-a24e-6473b23ebff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.217546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9b080-4dc4-4101-a24e-6473b23ebff7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.217821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9b080-4dc4-4101-a24e-6473b23ebff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.218091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9b080-4dc4-4101-a24e-6473b23ebff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.316651 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9b080-4dc4-4101-a24e-6473b23ebff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.318178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9b080-4dc4-4101-a24e-6473b23ebff7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.350655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4d10-4105-4cf4-b9ae-44a16df50689 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.367269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:52.388450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f7ef3-1834-4cab-821b-b50e30da702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.389222 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7ef3-1834-4cab-821b-b50e30da702b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.389604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7ef3-1834-4cab-821b-b50e30da702b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.389973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7ef3-1834-4cab-821b-b50e30da702b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.428828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:52.440654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 375/749] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:23:52.441909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9b080-4dc4-4101-a24e-6473b23ebff7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.492587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f7ef3-1834-4cab-821b-b50e30da702b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.494406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f7ef3-1834-4cab-821b-b50e30da702b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.558131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9b080-4dc4-4101-a24e-6473b23ebff7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.596645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.597322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.597603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.597895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.598800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:52.599108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.600655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.614639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 375/750] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:23:52.615839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f7ef3-1834-4cab-821b-b50e30da702b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.621605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:52.626484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 376/751] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:52.627478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.675626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:52.722370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f7ef3-1834-4cab-821b-b50e30da702b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.738112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511e008-f070-40fa-9791-7d0922b11a0d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.758325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.759572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.759854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.760138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.770455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.771924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.776086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.776791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.776999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.777276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:52.786853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:52.787803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:52.789289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:52.789289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:52.789289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:52.789460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.789546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 376/752] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:52.789546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.789880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:52.806481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:52.807460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:52.808342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:52.808342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:52.808342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:52.812378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 377/753] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:52.813316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.871207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:52.891898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4c426-bb38-44c0-af1d-9668d2cd8a08 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.899041 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:52.931086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.931747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.931996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.932330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.933894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3268c9-dc7a-4939-9520-8878742926f0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:52.953283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.955103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:52.972574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:52.973812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:52.974935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:52.974935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:52.974935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:52.975235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:52.975938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 377/754] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:52.976159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:52.976669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:52.976918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:52.977761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:52.978671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:52.979114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:52.980907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:52.995169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 378/755] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:52.996502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.088116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af968981-13fc-42e4-a040-f179a2fc74a8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.107461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea326597-5d53-46a9-a0c5-3eb1c4fe5aea None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.123384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.123750 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:53.124163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.124606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.124845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.125552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:53.125924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.127424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.144265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 378/756] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:53.144265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.153136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.153837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.154187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.154559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.155785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:53.156164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.157611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.168652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:53.173155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 379/757] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:53.174515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.313144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7720c-903f-4006-a775-ccacd2b086b5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.314185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca33cab-24e0-4ee3-87d3-767f320c8a23 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.356772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.357465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.357750 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.358122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.359617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.360569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.361246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.361526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.365694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.367247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.369452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.371352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:53.379789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:53.380674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:53.381577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:53.381577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:53.381577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:53.381577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:53.381577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:53.381577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:53.381577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:53.381577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:53.384175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:53.386326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 379/759] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:53.388442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.389461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 380/759] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:53.389461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.429716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:53.496270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:53.512761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b09a1-9d59-42fc-a80e-529b2ae7a4cf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.528508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ab8a-5747-489d-aa57-ccedf7034fc1 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.551933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.552545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.552820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.553087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.553781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:53.554352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.555599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.570636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 381/760] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:53.570790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eccb4-6e30-4f0a-a83a-bfe790225706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.570891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.571022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eccb4-6e30-4f0a-a83a-bfe790225706 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.571022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eccb4-6e30-4f0a-a83a-bfe790225706 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.571022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eccb4-6e30-4f0a-a83a-bfe790225706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.579960 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eccb4-6e30-4f0a-a83a-bfe790225706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.581402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eccb4-6e30-4f0a-a83a-bfe790225706 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-fb2eccb4-6e30-4f0a-a83a-bfe790225706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:53.593112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:53.594183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:53.595312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:53.595312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:53.595312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:53.595312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:53.595312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:53.595312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:53.595312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:53.595312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:53.597464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 380/761] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:53.599080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82841-c29b-4564-97fb-a21580249122 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.599999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82841-c29b-4564-97fb-a21580249122 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.600436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82841-c29b-4564-97fb-a21580249122 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.601862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 381/762] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:53.603536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e82841-c29b-4564-97fb-a21580249122 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.667796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:53.677490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08dd00-e254-45a2-8234-f8f0cf5e0b54 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.712257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e82841-c29b-4564-97fb-a21580249122 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.715596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.716300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.716577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.716852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.717639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:53.717944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.719408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.736640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 382/763] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:53.736640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.751986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a43c2-e733-4d6e-a6af-f9674f5c6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.752470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a43c2-e733-4d6e-a6af-f9674f5c6861 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.752818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a43c2-e733-4d6e-a6af-f9674f5c6861 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.753085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a43c2-e733-4d6e-a6af-f9674f5c6861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.753820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a43c2-e733-4d6e-a6af-f9674f5c6861 None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=d79837cddc7b4e4dbf0dbe16d50fa0fa) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:53.754126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a43c2-e733-4d6e-a6af-f9674f5c6861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.755605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a43c2-e733-4d6e-a6af-f9674f5c6861 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.770516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 382/764] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/role_assignments?user.id=d79837cddc7b4e4dbf0dbe16d50fa0fa&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:53.770516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c88ff-8c38-482c-b58b-9487dcdde587 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.770516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c88ff-8c38-482c-b58b-9487dcdde587 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.770516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c88ff-8c38-482c-b58b-9487dcdde587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.776747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:53.792088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b42c88ff-8c38-482c-b58b-9487dcdde587 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:53.793631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b42c88ff-8c38-482c-b58b-9487dcdde587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:53.869539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7f869-a740-46f9-87c7-f55a8b1529b6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:53.881672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 383/765] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:23:53.882578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c88ff-8c38-482c-b58b-9487dcdde587 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.906675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:53.907449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:53.907848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:53.908222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:53.909029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:53.909437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:53.911019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:53.928284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 383/766] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:53.929391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:53.954500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:54.000418 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c88ff-8c38-482c-b58b-9487dcdde587 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:54.037752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:54.043734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:54.044962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.045425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.046216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.047403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=d3dd402dbe75410aa87c433cbde181c3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:54.048336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:54.050070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:54.058150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 384/767] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/role_assignments?user.id=d3dd402dbe75410aa87c433cbde181c3&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=45149274288845b0a73e18fbb3394202 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:54.059043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:54.089066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9687a5-7cce-4848-af72-b7331483610d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:54.195427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c4b51-7d23-4c98-bdf5-b73461bb1663 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:54.211258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:54.212454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.212731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.213039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] PATH_INFO: `/v3/services/network` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.214182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:54.215247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:54.237470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e733ca-d3b9-4a3f-98b0-f1f76a8f58ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:54.238138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e733ca-d3b9-4a3f-98b0-f1f76a8f58ba None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.238408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e733ca-d3b9-4a3f-98b0-f1f76a8f58ba None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.238700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e733ca-d3b9-4a3f-98b0-f1f76a8f58ba None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/74d6165eeb524d18aa963f3dcaf84dd4/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:54.240357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:54.241549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:54.242695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:54.243555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e733ca-d3b9-4a3f-98b0-f1f76a8f58ba None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=74d6165eeb524d18aa963f3dcaf84dd4, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:54.243632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 384/768] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:53 2022] GET /identity/v3/services/network => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:54.243700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e733ca-d3b9-4a3f-98b0-f1f76a8f58ba None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:54.250245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:54.342585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 385/769] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:23:54 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/74d6165eeb524d18aa963f3dcaf84dd4/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:54.343737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8788e-2aab-492d-9945-f1653718e90f None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.344040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8788e-2aab-492d-9945-f1653718e90f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.344306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8788e-2aab-492d-9945-f1653718e90f None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.345692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 386/770] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:54.347386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:54.354283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df8bf-e16b-46a6-a6e6-bc3354bc04ad None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.354761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df8bf-e16b-46a6-a6e6-bc3354bc04ad None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.355111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df8bf-e16b-46a6-a6e6-bc3354bc04ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.378617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-718df8bf-e16b-46a6-a6e6-bc3354bc04ad None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:54.380372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-718df8bf-e16b-46a6-a6e6-bc3354bc04ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:54.383001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b31530-0c00-44db-a9ab-584313a5f72c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:54.445343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:54.470781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 387/771] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:23:54.471433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:54.472132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.472483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.472815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.473526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] RBAC: Adding query filter params (name=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:54.473924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:54.475387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:54.483138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 385/772] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:23:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:54.488724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718df8bf-e16b-46a6-a6e6-bc3354bc04ad None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:54.508143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:54.644768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718df8bf-e16b-46a6-a6e6-bc3354bc04ad None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:54.683275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:54.684265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.684772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.685257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.686092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] RBAC: Adding query filter params (type=network) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:54.686630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:54.688359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:54.694160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 388/773] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:23:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:54.701189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:54.702679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c65409-cbab-46e2-bd23-4381660fe457 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:54.778859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:54.781518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:54.783115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.785053 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.785418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.786849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:54.788499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:54.813414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:54.814492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:54.815357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:54.819122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 386/774] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Aug 10 08:23:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:23:54.821870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:54.838826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:54.879997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782767d1-29ab-481e-8160-e6016b1dde1f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:54.966307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7116ffd-8ab6-4f8a-93f5-5f8444afe3b4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:54.996845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:54.998447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:54.998747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:54.999016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:54.999730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] RBAC: Adding query filter params (interface=public, service_id=1e56f4a98aaf441cb7c23aa65741bbf6, region_id=RegionOne) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:55.000035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:55.001406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:55.007934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:55.009223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:55.009506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:55.009773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:55.010407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:55.010727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:55.012085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:55.019856 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 387/775] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 10 08:23:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:55.020130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 389/776] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 10 08:23:54 2022] GET /identity/v3/endpoints?service_id=1e56f4a98aaf441cb7c23aa65741bbf6&interface=public®ion_id=RegionOne => generated 194 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:55.024279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:55.027387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:55.148925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:55.184681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0291ccc-8782-43b2-9447-208dc44ec218 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:55.222005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0831b9-2cb5-4655-b046-1d83bee25bc8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:55.250901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:55.254926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:55.255541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:55.255843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:55.256117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:55.256760 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:55.257068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:55.258529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:55.278280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 388/777] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 10 08:23:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:55.280032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:55.299197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a8fb-d001-4d8f-8c17-928f1b5e084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:55.299815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a8fb-d001-4d8f-8c17-928f1b5e084f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:55.300094 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a8fb-d001-4d8f-8c17-928f1b5e084f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:55.300366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a8fb-d001-4d8f-8c17-928f1b5e084f None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:55.300977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4a8fb-d001-4d8f-8c17-928f1b5e084f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:55.302345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4a8fb-d001-4d8f-8c17-928f1b5e084f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:55.315168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 390/778] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:23:55 2022] GET /identity/v3/services => generated 772 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:55.441923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c382d87-a95d-404a-aefe-2654b7a33140 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:55.486716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:55.496267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1be50a-0cd9-4339-8eca-670ef417bc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:55.496958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1be50a-0cd9-4339-8eca-670ef417bc66 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:55.497231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1be50a-0cd9-4339-8eca-670ef417bc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:55.497507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1be50a-0cd9-4339-8eca-670ef417bc66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:55.498393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1be50a-0cd9-4339-8eca-670ef417bc66 None admin] RBAC: Adding query filter params (interface=public, service_id=846febc53cc845e68bd31ca7e85de634, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:55.498633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1be50a-0cd9-4339-8eca-670ef417bc66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:55.500068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1be50a-0cd9-4339-8eca-670ef417bc66 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:55.513457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 389/779] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 10 08:23:55 2022] GET /identity/v3/endpoints?service_id=846febc53cc845e68bd31ca7e85de634&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:55.518587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a8fb-d001-4d8f-8c17-928f1b5e084f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:55.636926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a8fb-d001-4d8f-8c17-928f1b5e084f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:55.673690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfcb31-1b04-424f-9307-96674f37f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:55.674300 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfcb31-1b04-424f-9307-96674f37f365 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:55.674607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfcb31-1b04-424f-9307-96674f37f365 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:55.674882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfcb31-1b04-424f-9307-96674f37f365 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:55.675492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfcb31-1b04-424f-9307-96674f37f365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:55.676864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfcb31-1b04-424f-9307-96674f37f365 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:55.682696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 391/780] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:23:55 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:56.094447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb7ab5-4fe3-4bc1-86d5-325d0091c9b9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.095191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb7ab5-4fe3-4bc1-86d5-325d0091c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.095733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb7ab5-4fe3-4bc1-86d5-325d0091c9b9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.097594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 390/781] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:56.103070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15917-94d9-4e02-8251-05e5d90ff2d3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.103934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15917-94d9-4e02-8251-05e5d90ff2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.104422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15917-94d9-4e02-8251-05e5d90ff2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.123189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-adc15917-94d9-4e02-8251-05e5d90ff2d3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:56.124738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-adc15917-94d9-4e02-8251-05e5d90ff2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:56.164342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:56.210232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 392/782] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:23:56.248438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb7ab5-4fe3-4bc1-86d5-325d0091c9b9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:56.276368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78258-dd72-4ece-b585-1ea8e5154de9 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.276683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78258-dd72-4ece-b585-1ea8e5154de9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.276924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78258-dd72-4ece-b585-1ea8e5154de9 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.278403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 393/783] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:56.284795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768954d-0893-49ef-bef1-7a4614450b3e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.285032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768954d-0893-49ef-bef1-7a4614450b3e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.285312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768954d-0893-49ef-bef1-7a4614450b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.312031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-6768954d-0893-49ef-bef1-7a4614450b3e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:56.313251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6768954d-0893-49ef-bef1-7a4614450b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:56.367553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb7ab5-4fe3-4bc1-86d5-325d0091c9b9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:56.404904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc557354-e7bb-4adc-9020-404415f7e45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:56.405902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc557354-e7bb-4adc-9020-404415f7e45e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.406496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc557354-e7bb-4adc-9020-404415f7e45e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.406970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc557354-e7bb-4adc-9020-404415f7e45e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.421068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc557354-e7bb-4adc-9020-404415f7e45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-dc557354-e7bb-4adc-9020-404415f7e45e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:56.426837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:56.427759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:23:56.428605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:56.431264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 391/784] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:23:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:56.437644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc557354-e7bb-4adc-9020-404415f7e45e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:56.453583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 394/785] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:23:56.479389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768954d-0893-49ef-bef1-7a4614450b3e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:56.528317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:56.618868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc557354-e7bb-4adc-9020-404415f7e45e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:56.635279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768954d-0893-49ef-bef1-7a4614450b3e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:56.638205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:56.682933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:56.683535 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.683806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.684071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.684734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:56.685706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:56.687093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:56.697468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077a728-27e2-4bd3-b6b3-b88f336ae70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:56.698094 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077a728-27e2-4bd3-b6b3-b88f336ae70e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.698367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077a728-27e2-4bd3-b6b3-b88f336ae70e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.698657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077a728-27e2-4bd3-b6b3-b88f336ae70e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.707423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 392/786] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:23:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:23:56.715548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:56.718904 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077a728-27e2-4bd3-b6b3-b88f336ae70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-c077a728-27e2-4bd3-b6b3-b88f336ae70e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:56.723613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:56.724526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:56.725376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:56.726019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 395/787] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:56.738188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077a728-27e2-4bd3-b6b3-b88f336ae70e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:56.876117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854a28-0ad6-4ff8-bc1e-8263c5b10b06 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:56.894927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:56.910411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077a728-27e2-4bd3-b6b3-b88f336ae70e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:56.914864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d18a2-5781-4aa4-a314-5ca9a627ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:56.914864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d18a2-5781-4aa4-a314-5ca9a627ceec None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.914864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d18a2-5781-4aa4-a314-5ca9a627ceec None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.914864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d18a2-5781-4aa4-a314-5ca9a627ceec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.932581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d18a2-5781-4aa4-a314-5ca9a627ceec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:56.935644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d18a2-5781-4aa4-a314-5ca9a627ceec None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:56.951291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be0b17-0b53-4961-8b21-fdf4654643a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:56.951900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0b17-0b53-4961-8b21-fdf4654643a3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.952177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0b17-0b53-4961-8b21-fdf4654643a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.952448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0b17-0b53-4961-8b21-fdf4654643a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.953543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0b17-0b53-4961-8b21-fdf4654643a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:56.953849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0b17-0b53-4961-8b21-fdf4654643a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:56.955598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0b17-0b53-4961-8b21-fdf4654643a3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ad0d18a2-5781-4aa4-a314-5ca9a627ceec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:56.959800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:56.960726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:56.961720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:56.961720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:56.961720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:56.963839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 393/788] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:56.965249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924998-a806-4b2f-8ede-fccfb3a50386 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.965744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924998-a806-4b2f-8ede-fccfb3a50386 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.966286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924998-a806-4b2f-8ede-fccfb3a50386 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:56.968050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 394/789] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:56.974043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 396/790] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:56.975089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924998-a806-4b2f-8ede-fccfb3a50386 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:56.978134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfeb2-49e1-4427-af2f-820db97ff2f5 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:56.978134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfeb2-49e1-4427-af2f-820db97ff2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:56.978134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfeb2-49e1-4427-af2f-820db97ff2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.000121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-047cfeb2-49e1-4427-af2f-820db97ff2f5 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:57.001792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-047cfeb2-49e1-4427-af2f-820db97ff2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:57.022043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:57.082747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 397/791] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:23:57.083776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cfeb2-49e1-4427-af2f-820db97ff2f5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.105342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924998-a806-4b2f-8ede-fccfb3a50386 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.148187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.149896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.150839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.151385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.152298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:57.152997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.155003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:57.168948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 395/792] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:57.174436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.208105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:57.209082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cfeb2-49e1-4427-af2f-820db97ff2f5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.246551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.247181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.247506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.247778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.263272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.263561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:57.279939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:57.281215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:57.282120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:57.282120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:57.282120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:57.282120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 398/793] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:57.282344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.291032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5785d-22b7-443d-a2b1-5c39b774b383 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.292493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:57.328826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162b42e-a563-4754-af06-71b4afe79876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.329870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b42e-a563-4754-af06-71b4afe79876 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.330378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b42e-a563-4754-af06-71b4afe79876 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.330883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b42e-a563-4754-af06-71b4afe79876 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.342787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162b42e-a563-4754-af06-71b4afe79876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d162b42e-a563-4754-af06-71b4afe79876 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:23:57.348132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:57.349067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:23:57.349919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:57.352895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 396/794] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:57.353988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162b42e-a563-4754-af06-71b4afe79876 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.394162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb9adf-02b8-4289-b180-1ae4f9eac2b4 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.429065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.430003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.430003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.430240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.437841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.439546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:57.450984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:57.451951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:23:57.452887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:57.456850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 399/795] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:57.457739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.464902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:57.475003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162b42e-a563-4754-af06-71b4afe79876 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.512181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.513146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.513803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.514281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.515214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:57.515751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.517624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:57.523940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:57.532089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 397/796] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:57.533245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.560661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1115a-5675-416a-ae44-7f7bff9b91a1 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.596849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.597606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.597889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.598213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.599240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:57.599546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.601155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:57.617190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 400/797] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:57.618195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.651636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc34d-61f8-4d89-98c0-6022a0714fe6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.696843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.697450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.697722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.698019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.699353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:57.699659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.701368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:57.726626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 398/798] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:57.727872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.738825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:57.744807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a087dcd-213a-4eed-99a1-cc707bcb2f3f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.780713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:57.791721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.792646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.792925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.793191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.803194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.804637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:57.819906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:57.821492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:57.822459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 401/799] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:57.823090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.837726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65eae4-2309-48ee-a75f-a3f345b29057 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.874135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.875130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.875619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.876097 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.887373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.888936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:57.906085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:57.907121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:57.908610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:57.908610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:57.908610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:57.908610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 399/800] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:57.908610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:57.936811 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd1a6-d5bb-4776-8215-239654fd3979 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:57.978129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:57.980265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc3dfa-b211-4292-8c33-928ee306ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:57.980887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc3dfa-b211-4292-8c33-928ee306ca9d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:57.981162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc3dfa-b211-4292-8c33-928ee306ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:57.981776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc3dfa-b211-4292-8c33-928ee306ca9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:57.992310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc3dfa-b211-4292-8c33-928ee306ca9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:57.994097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc3dfa-b211-4292-8c33-928ee306ca9d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-47dc3dfa-b211-4292-8c33-928ee306ca9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:58.009032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:58.009993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:58.010964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:58.010964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:58.010964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:58.010964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 402/801] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:58.011630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faebfb9-3eac-4ae8-99e0-a7134453ce76 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.011630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faebfb9-3eac-4ae8-99e0-a7134453ce76 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.011892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faebfb9-3eac-4ae8-99e0-a7134453ce76 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.013249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 403/802] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:58.015876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faebfb9-3eac-4ae8-99e0-a7134453ce76 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.028023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778384-6b0c-483c-8ce2-18d285694069 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.062678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:58.067978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.068592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.068874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.069147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.070336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:58.070514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.072009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.094403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 400/803] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 10 08:23:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:58.095173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.125827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faebfb9-3eac-4ae8-99e0-a7134453ce76 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.161217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742753a-2bc0-476f-ac56-9ead42f28fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.162118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742753a-2bc0-476f-ac56-9ead42f28fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.162400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742753a-2bc0-476f-ac56-9ead42f28fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.162830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742753a-2bc0-476f-ac56-9ead42f28fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.163474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742753a-2bc0-476f-ac56-9ead42f28fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:58.163773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742753a-2bc0-476f-ac56-9ead42f28fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.165777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742753a-2bc0-476f-ac56-9ead42f28fa1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.177037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 404/804] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:58.178247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cbd18-da19-49fc-95ae-07781ad12707 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.178554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cbd18-da19-49fc-95ae-07781ad12707 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.178824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cbd18-da19-49fc-95ae-07781ad12707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.196971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-359cbd18-da19-49fc-95ae-07781ad12707 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:58.198154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-359cbd18-da19-49fc-95ae-07781ad12707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:58.204222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99bb41-c73b-4870-bf73-f4991dd1a78e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.222300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:58.239001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.239607 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.239881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.240149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.240789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:58.241088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.242437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.253472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 401/805] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:58.254080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.270519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 405/806] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:23:58.270519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaecb1-8d59-4bfd-bc52-42dda8d08c90 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.270519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaecb1-8d59-4bfd-bc52-42dda8d08c90 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.270519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaecb1-8d59-4bfd-bc52-42dda8d08c90 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.271217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 406/807] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:23:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:23:58.271604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaecb1-8d59-4bfd-bc52-42dda8d08c90 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.311631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:58.360948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586ffd5-11d3-4678-9384-914b6dfd86e3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.385024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaecb1-8d59-4bfd-bc52-42dda8d08c90 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.393472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.394103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.394381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.394683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.407579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.409116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.419241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062561f7-e374-4d46-a9a6-27b79f16df7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.419860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062561f7-e374-4d46-a9a6-27b79f16df7a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.420136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062561f7-e374-4d46-a9a6-27b79f16df7a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.420435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062561f7-e374-4d46-a9a6-27b79f16df7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:58.422875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:58.423978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:58.424926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:58.424926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:58.424926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:58.424926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 402/808] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:58.424926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.430343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062561f7-e374-4d46-a9a6-27b79f16df7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.431808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062561f7-e374-4d46-a9a6-27b79f16df7a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-062561f7-e374-4d46-a9a6-27b79f16df7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:23:58.443845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:58.450268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 407/809] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182316c-8056-4456-825f-52a0518dc5ad None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.451531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182316c-8056-4456-825f-52a0518dc5ad None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.452406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182316c-8056-4456-825f-52a0518dc5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.460979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:58.465041 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b182316c-8056-4456-825f-52a0518dc5ad None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:23:58.466232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b182316c-8056-4456-825f-52a0518dc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:23:58.530028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059871-8586-43ea-9a22-641b7a078cad None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.530567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 408/810] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:23:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:23:58.531148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182316c-8056-4456-825f-52a0518dc5ad None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.557378 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:58.564401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.565032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.565309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.565578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.572403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.573849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:58.584729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:58.585894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 403/811] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:58.587973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.637516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182316c-8056-4456-825f-52a0518dc5ad None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.671156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.671779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.672054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.672325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.672902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.674257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.674602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:58.684526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442a632-7988-40d6-bae4-521e77a8dfdd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:58.684816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:58.692042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:58.692987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 409/812] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:58.694282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.720004 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.720605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.720880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.721208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.721853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:58.722152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.723536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.734395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 404/813] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:58.735203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.774144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:58.788949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a775e-e3a8-4a81-866b-f952d9e152f9 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.822748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.823345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.823625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.823895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.824615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:58.824915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.826343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.832655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096760b-1161-4836-a33c-341e4186e3e4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.842812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 410/814] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:58.843573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.865821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.866434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.866750 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.867020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.867593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.869447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:58.877761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:58.878873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:58.879718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 405/815] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:58.880523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.896798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:58.941454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dda91-1874-4e32-aec2-a9ec4ddda37b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.975109 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:58.975700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:58.975975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:58.976241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:58.976922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:58.977735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:58.979181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:58.980778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3f72-5cb0-463f-a68f-44c1cc2696e0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:58.990068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 411/816] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:58.990868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:58.993894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:59.018243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.018871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.019148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.019420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.020043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] RBAC: Adding query filter params (name=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:59.020337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.021680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.025996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 406/817] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:59.026788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.092229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3925245-34fb-4715-8df5-c9996f196d14 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.100260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:59.121549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa0329-cf57-4e9b-bc7e-e6c134d4489d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.125323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253485c-d266-460f-960a-0b745db94007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.125939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253485c-d266-460f-960a-0b745db94007 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.126215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253485c-d266-460f-960a-0b745db94007 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.126500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253485c-d266-460f-960a-0b745db94007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.133126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253485c-d266-460f-960a-0b745db94007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.134791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253485c-d266-460f-960a-0b745db94007 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-8253485c-d266-460f-960a-0b745db94007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:23:59.146371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:59.147351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 412/818] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:59.148325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253485c-d266-460f-960a-0b745db94007 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.157396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63523-0472-4b84-b712-bd84a4b80059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.157993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63523-0472-4b84-b712-bd84a4b80059 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.158272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63523-0472-4b84-b712-bd84a4b80059 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.158567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63523-0472-4b84-b712-bd84a4b80059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.207142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:59.224847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63523-0472-4b84-b712-bd84a4b80059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.226287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63523-0472-4b84-b712-bd84a4b80059 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.245593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253485c-d266-460f-960a-0b745db94007 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.279601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.280189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.280465 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.280733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.281358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:59.281660 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.283253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.293693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 413/819] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 10 08:23:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:59.293693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.308496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:59.340138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 407/820] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:23:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:23:59.341111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63523-0472-4b84-b712-bd84a4b80059 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.411233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237b42-3db4-49c9-b3a1-84d125e3403b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.437282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:59.445918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd029bdd-b9d2-422d-8db1-98fbaa30a9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.446599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd029bdd-b9d2-422d-8db1-98fbaa30a9ef None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.446882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd029bdd-b9d2-422d-8db1-98fbaa30a9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.447151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd029bdd-b9d2-422d-8db1-98fbaa30a9ef None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/d79837cddc7b4e4dbf0dbe16d50fa0fa/roles/2d8d67bb4f814a2da8c49bd7f01cf98e` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.449888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63523-0472-4b84-b712-bd84a4b80059 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.461888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd029bdd-b9d2-422d-8db1-98fbaa30a9ef None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=d79837cddc7b4e4dbf0dbe16d50fa0fa, role_id=2d8d67bb4f814a2da8c49bd7f01cf98e)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.463355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd029bdd-b9d2-422d-8db1-98fbaa30a9ef None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.484085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.484687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.484964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.485233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.485862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] RBAC: Adding query filter params (type=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:59.486152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.487541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.492761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 408/821] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:23:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:59.493357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.531691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 414/822] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:23:59 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/d79837cddc7b4e4dbf0dbe16d50fa0fa/roles/2d8d67bb4f814a2da8c49bd7f01cf98e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:23:59.532559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd029bdd-b9d2-422d-8db1-98fbaa30a9ef None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.549511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:59.615914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260966c-cea1-4b96-862e-f8cab79dd2ca None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.659750 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.660364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.660638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.660906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.661665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:59.661907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.663404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.682203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 409/823] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:23:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:59.682203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.691892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd029bdd-b9d2-422d-8db1-98fbaa30a9ef None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.729596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.730202 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.730501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.730810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.731446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:23:59.731749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.733182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.738440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 415/824] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 10 08:23:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:23:59.739072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.786939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:59.791949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd07c4-4d3c-48bc-9208-42d5d1f47315 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.793637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:23:59.827213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.827868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.828146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.828412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.839268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.840708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.849330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fa323-3e8c-436c-bd50-80da0c08c4e4 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:23:59.855952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:23:59.856915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:23:59.857862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:23:59.857862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:23:59.857862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:23:59.857862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 410/825] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:23:59.858605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:23:59.888804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9daf-3da6-4403-8c30-5be96f4393d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:23:59.889410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9daf-3da6-4403-8c30-5be96f4393d9 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:23:59.889714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9daf-3da6-4403-8c30-5be96f4393d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:23:59.889964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9daf-3da6-4403-8c30-5be96f4393d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:23:59.890646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9daf-3da6-4403-8c30-5be96f4393d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:23:59.892004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9daf-3da6-4403-8c30-5be96f4393d9 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:23:59.973475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5f29e-b559-44d3-9e59-f084609c41ce None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:00.003521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 416/826] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:23:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:00.003521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9daf-3da6-4403-8c30-5be96f4393d9 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:00.018985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae260f-b00d-437c-bd32-1684a71e0f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:00.020058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae260f-b00d-437c-bd32-1684a71e0f18 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:00.020331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae260f-b00d-437c-bd32-1684a71e0f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:00.020597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae260f-b00d-437c-bd32-1684a71e0f18 None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/d3dd402dbe75410aa87c433cbde181c3/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:00.022683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae260f-b00d-437c-bd32-1684a71e0f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=d3dd402dbe75410aa87c433cbde181c3, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:00.024204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae260f-b00d-437c-bd32-1684a71e0f18 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:00.109755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 411/827] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:23:59 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/d3dd402dbe75410aa87c433cbde181c3/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:00.109755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae260f-b00d-437c-bd32-1684a71e0f18 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:00.147455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:00.158317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:00.168329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9daf-3da6-4403-8c30-5be96f4393d9 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:00.209379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08337-b838-4bb6-92b5-d28b73a52998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:00.210713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08337-b838-4bb6-92b5-d28b73a52998 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:00.210713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08337-b838-4bb6-92b5-d28b73a52998 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:00.210713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08337-b838-4bb6-92b5-d28b73a52998 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:00.211142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a08337-b838-4bb6-92b5-d28b73a52998 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:00.213086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a08337-b838-4bb6-92b5-d28b73a52998 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:00.272207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae260f-b00d-437c-bd32-1684a71e0f18 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:00.309105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 417/828] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:23:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:00.326870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:00.327658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:00.328077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:00.328761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:00.329575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:00.329977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:00.331615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:00.347279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 412/829] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:00.354760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08337-b838-4bb6-92b5-d28b73a52998 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:00.477859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08337-b838-4bb6-92b5-d28b73a52998 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:00.516393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:00.517026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:00.517305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:00.517571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:00.526173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:00.527872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:00.539682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:00.540770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:00.541858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:00.541858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:00.541858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:00.541858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:00.541858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:00.541858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:00.541858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:00.541858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:00.544880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 418/830] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:00.549128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:00.620769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:00.657715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497eebcb-1f0d-4052-93ea-1e0fc5008027 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:00.692377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc80bb0-583f-4923-9563-7bb658748a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:00.692989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80bb0-583f-4923-9563-7bb658748a1f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:00.693268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80bb0-583f-4923-9563-7bb658748a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:00.693544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80bb0-583f-4923-9563-7bb658748a1f None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:00.694241 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80bb0-583f-4923-9563-7bb658748a1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:00.694842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80bb0-583f-4923-9563-7bb658748a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:00.696815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80bb0-583f-4923-9563-7bb658748a1f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:00.709424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 413/831] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:00.715834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:00.732830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:00.828936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b82dbf-eabd-47d0-93dc-d8a81f7c6d9f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:00.865129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabdcb2-dc43-4440-b035-bc36de00927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:00.865736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdcb2-dc43-4440-b035-bc36de00927e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:00.866015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdcb2-dc43-4440-b035-bc36de00927e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:00.866289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdcb2-dc43-4440-b035-bc36de00927e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:00.867058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabdcb2-dc43-4440-b035-bc36de00927e None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=74d6165eeb524d18aa963f3dcaf84dd4) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:00.867364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabdcb2-dc43-4440-b035-bc36de00927e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:00.869309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabdcb2-dc43-4440-b035-bc36de00927e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:00.875739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 419/832] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:00 2022] GET /identity/v3/role_assignments?user.id=74d6165eeb524d18aa963f3dcaf84dd4&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=45149274288845b0a73e18fbb3394202 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:01.656928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2de5-02a7-4926-b0a3-eb5f43dacf9d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:01.657470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2de5-02a7-4926-b0a3-eb5f43dacf9d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:01.657470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2de5-02a7-4926-b0a3-eb5f43dacf9d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:01.659089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 414/833] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:01.664352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949479dd-d8a6-47ef-808d-f13d45e58ac8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:01.665398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949479dd-d8a6-47ef-808d-f13d45e58ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:01.665474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949479dd-d8a6-47ef-808d-f13d45e58ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:01.683750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-949479dd-d8a6-47ef-808d-f13d45e58ac8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:01.684945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-949479dd-d8a6-47ef-808d-f13d45e58ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:01.753033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 420/834] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:01.776372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e2de5-02a7-4926-b0a3-eb5f43dacf9d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:01.884690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e2de5-02a7-4926-b0a3-eb5f43dacf9d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:01.911534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:01.920732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de726b-f207-4e89-8be5-839aa0744363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:01.921433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de726b-f207-4e89-8be5-839aa0744363 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:01.921715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de726b-f207-4e89-8be5-839aa0744363 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:01.921986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de726b-f207-4e89-8be5-839aa0744363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:01.933221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de726b-f207-4e89-8be5-839aa0744363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f4de726b-f207-4e89-8be5-839aa0744363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:01.937945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:01.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:01.944165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 415/835] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:01.947600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949479dd-d8a6-47ef-808d-f13d45e58ac8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:01.956776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:02.054266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949479dd-d8a6-47ef-808d-f13d45e58ac8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.089911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5719d81-18e4-4fb0-98e1-cd8c27bece77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.090542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719d81-18e4-4fb0-98e1-cd8c27bece77 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.090821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719d81-18e4-4fb0-98e1-cd8c27bece77 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.091090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719d81-18e4-4fb0-98e1-cd8c27bece77 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.091755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5719d81-18e4-4fb0-98e1-cd8c27bece77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:02.092052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5719d81-18e4-4fb0-98e1-cd8c27bece77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:02.093475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5719d81-18e4-4fb0-98e1-cd8c27bece77 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:02.102645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 421/836] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:24:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:02.111567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de726b-f207-4e89-8be5-839aa0744363 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.217484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de726b-f207-4e89-8be5-839aa0744363 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.232031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6c9d-eb39-4eb3-bfa6-75f5d494ed15 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.232316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6c9d-eb39-4eb3-bfa6-75f5d494ed15 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.232585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6c9d-eb39-4eb3-bfa6-75f5d494ed15 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.234064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 422/837] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:02.239655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6d9e-75dc-4df1-ae2b-027c9fd91b21 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.245445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6d9e-75dc-4df1-ae2b-027c9fd91b21 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.245445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6d9e-75dc-4df1-ae2b-027c9fd91b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.263487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4e3a6d9e-75dc-4df1-ae2b-027c9fd91b21 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:02.264506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.265139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.265413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.265607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4e3a6d9e-75dc-4df1-ae2b-027c9fd91b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:02.265710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.278380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:02.280549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:02.300525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:02.301489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:02.302398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:02.302398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:02.302398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:02.302398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 416/838] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:02.308679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.341446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:02.354920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:02.355097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 423/839] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:02.372471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a6d9e-75dc-4df1-ae2b-027c9fd91b21 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.414239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1541c-d307-4bdc-92a4-c549c46da71b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.450310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78282b62-9d98-4029-86d2-d0902b2ca98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.451319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282b62-9d98-4029-86d2-d0902b2ca98a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.451804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282b62-9d98-4029-86d2-d0902b2ca98a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.452276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282b62-9d98-4029-86d2-d0902b2ca98a None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.453190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78282b62-9d98-4029-86d2-d0902b2ca98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:02.453695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78282b62-9d98-4029-86d2-d0902b2ca98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:02.455402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78282b62-9d98-4029-86d2-d0902b2ca98a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:02.468849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 417/840] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:02.470361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ada4d5-1e00-4754-8c7a-55ca4c2ff8f7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.470910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ada4d5-1e00-4754-8c7a-55ca4c2ff8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.471387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ada4d5-1e00-4754-8c7a-55ca4c2ff8f7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.473082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 418/841] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:02.476619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ada4d5-1e00-4754-8c7a-55ca4c2ff8f7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.483128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a6d9e-75dc-4df1-ae2b-027c9fd91b21 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.518482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8288c74-fb2b-4fee-aa8b-cfdd9d4b4d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.519143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288c74-fb2b-4fee-aa8b-cfdd9d4b4d4f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.519422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288c74-fb2b-4fee-aa8b-cfdd9d4b4d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.519689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288c74-fb2b-4fee-aa8b-cfdd9d4b4d4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.530863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8288c74-fb2b-4fee-aa8b-cfdd9d4b4d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-d8288c74-fb2b-4fee-aa8b-cfdd9d4b4d4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:02.535462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:02.536389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:02.537225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 424/842] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:02.538930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5811804-6ab3-4f1a-a24e-0866227d6c1b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.538930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5811804-6ab3-4f1a-a24e-0866227d6c1b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.538930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5811804-6ab3-4f1a-a24e-0866227d6c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.556988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a5811804-6ab3-4f1a-a24e-0866227d6c1b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:02.558183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a5811804-6ab3-4f1a-a24e-0866227d6c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:02.590116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:02.595088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ada4d5-1e00-4754-8c7a-55ca4c2ff8f7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.617370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:02.630666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.631153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 425/843] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:02.631287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.631567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.631940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.632623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5811804-6ab3-4f1a-a24e-0866227d6c1b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.651648 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:02.653551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:02.667016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:02.668772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:02.670224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 419/844] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:02.673361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.747244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5811804-6ab3-4f1a-a24e-0866227d6c1b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.778877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f344d-9461-46a4-9fa0-96e2380aea21 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.782147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.782784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.783136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.783479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.784218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:02.784610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:02.786062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:02.799713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 426/845] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:02.799713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.819290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.820250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.821169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.821508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.822588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:02.824009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:02.832777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:02.834000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:02.835048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:02.839774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 420/846] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:02.840513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.853950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:02.867209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:02.907209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52caff5-1fb8-41dc-831e-dcada2e0ab50 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.950164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.950420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b4041-00bd-4ab1-b8d2-c7cc6a019ea9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:02.950931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.951275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.951609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.952454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:02.952828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:02.954256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:02.972102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 427/847] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:02.972833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:02.987868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326358cb-9c51-4f20-bc9c-ccd9347ef8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:02.988496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326358cb-9c51-4f20-bc9c-ccd9347ef8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:02.988770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326358cb-9c51-4f20-bc9c-ccd9347ef8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:02.989034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326358cb-9c51-4f20-bc9c-ccd9347ef8d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:02.998931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326358cb-9c51-4f20-bc9c-ccd9347ef8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.000302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326358cb-9c51-4f20-bc9c-ccd9347ef8d7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-326358cb-9c51-4f20-bc9c-ccd9347ef8d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:03.014801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:03.015935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:03.017023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:03.017023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:03.017023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:03.017023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 421/848] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:03.017308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fe940-9ae5-44a1-9bac-93a7543c2abc None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.017308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fe940-9ae5-44a1-9bac-93a7543c2abc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.017576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fe940-9ae5-44a1-9bac-93a7543c2abc None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.020186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 422/849] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:03.020186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fe940-9ae5-44a1-9bac-93a7543c2abc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.075526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a9339-9898-44a0-a2b1-180848065980 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.084548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:03.095688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:03.108011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.108601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.108875 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.109139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.109795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:03.110089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.111464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.115716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 428/850] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:03.116465 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.122454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fe940-9ae5-44a1-9bac-93a7543c2abc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.156223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ccd8-99fb-4dd0-91f7-6d5fc3d7f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.156824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ccd8-99fb-4dd0-91f7-6d5fc3d7f1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.157102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ccd8-99fb-4dd0-91f7-6d5fc3d7f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.157372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ccd8-99fb-4dd0-91f7-6d5fc3d7f1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.214481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b969-5c36-4879-aa28-aee6fcaa4167 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.224133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ccd8-99fb-4dd0-91f7-6d5fc3d7f1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.225608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ccd8-99fb-4dd0-91f7-6d5fc3d7f1d0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.248045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91af96-eb53-47a1-af07-50b77b2317b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.248623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91af96-eb53-47a1-af07-50b77b2317b5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.248890 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91af96-eb53-47a1-af07-50b77b2317b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.249215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91af96-eb53-47a1-af07-50b77b2317b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.249783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91af96-eb53-47a1-af07-50b77b2317b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:03.250074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91af96-eb53-47a1-af07-50b77b2317b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.251447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91af96-eb53-47a1-af07-50b77b2317b5 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.262737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 429/851] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:03.263871 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37925f-470f-4295-8791-252530d41bd4 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.264146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37925f-470f-4295-8791-252530d41bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.264407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37925f-470f-4295-8791-252530d41bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.281387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8d37925f-470f-4295-8791-252530d41bd4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:03.282581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8d37925f-470f-4295-8791-252530d41bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:03.302137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:03.307876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:03.327751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 423/852] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:24:03.328572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ccd8-99fb-4dd0-91f7-6d5fc3d7f1d0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.347977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 430/853] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:03.348799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37925f-470f-4295-8791-252530d41bd4 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.428123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ccd8-99fb-4dd0-91f7-6d5fc3d7f1d0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.448141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37925f-470f-4295-8791-252530d41bd4 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.460774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.461399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.461668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.461928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.462577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:03.462874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.464219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.468740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 424/854] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:03.469503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.494774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.495421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.495696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.495965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.504287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.505662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:03.518247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:03.519493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 08:24:03.520698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:03.521955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:03.524274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 431/855] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:03.525240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.555936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:03.591953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391fd2b-5522-4ab5-8a5e-bcb042543ac7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.632774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.632983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.633192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.633463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.642569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e784a66-074d-47c1-bd1f-a29a79cfa48d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.644830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.646356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:03.663480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:03.665181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:03.666211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:03.666211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:03.666211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:03.666211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 425/856] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:03.670287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.684250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.684888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.685164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.685431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.686562 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.687924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:03.697069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:03.698207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:03.699140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 432/857] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:03.699930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.771562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:03.782074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a267-b0ae-424f-9127-3a532491e4b9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.793323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:03.809423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4c4c-e7cd-4111-8e76-1738ad857974 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.820478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.821116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.821392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.821669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.822397 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:03.822724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.824156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.842198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 426/858] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:03.842198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.850888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.851558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.852440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.852778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.853509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:03.853788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.855218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:03.867951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 433/859] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:03.868959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:03.958862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4c0e-99c4-46bb-a7e5-81a3f5d773f0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.979090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b839a24-f689-46f6-afcf-6cc3d498b26e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:03.994796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:03.995404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:03.995709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:03.995965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:03.996594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:03.996902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:03.998271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.002840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 427/860] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:04.003617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:04.017992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:04.022610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70c0e-cd86-4984-b77f-e79a629b727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:04.023154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70c0e-cd86-4984-b77f-e79a629b727c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:04.023430 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70c0e-cd86-4984-b77f-e79a629b727c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:04.024207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70c0e-cd86-4984-b77f-e79a629b727c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:04.040200 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:04.095550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f70c0e-cd86-4984-b77f-e79a629b727c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:04.096989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f70c0e-cd86-4984-b77f-e79a629b727c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.111915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fae9f8-5117-4827-a9fa-e8340a88b6c0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:04.149383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:04.150011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:04.150284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:04.150580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:04.157812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:04.159290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:04.171194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:04.172190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:04.173123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 428/861] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:04.173623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:04.213560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 434/862] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:24:04.213560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70c0e-cd86-4984-b77f-e79a629b727c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:04.251859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:04.260180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:04.282956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c6fe3-d5dc-4b69-9300-d3bdacdade15 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:04.317825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70c0e-cd86-4984-b77f-e79a629b727c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:04.317989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:04.318483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:04.318812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:04.319087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:04.320008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:04.320312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:04.322198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.334502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 429/863] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:04.334502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:04.365147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:04.365858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:04.366208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:04.366587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:04.367526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:04.367894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:04.369678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.384058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 435/864] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:04.390086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:04.462758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f61d4a-76d0-40ac-b901-36c6d3196893 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:04.510099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:04.510889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:04.511156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:04.511429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:04.514403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:04.524556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:04.528549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.528670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d1eef-4d14-41ba-8be1-74f72f7ba7cc None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:04.536171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:04.544412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:04.545394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:04.546313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:04.546313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:04.546313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:04.546313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 430/865] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:04.551394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:04.573641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:04.574253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:04.574571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:04.574848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:04.575595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=d79837cddc7b4e4dbf0dbe16d50fa0fa) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:04.575917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:04.577348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.584156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 436/866] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:04 2022] GET /identity/v3/role_assignments?user.id=d79837cddc7b4e4dbf0dbe16d50fa0fa&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:04.675246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88addb18-3bf8-4bd6-9d91-00600a162bd2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:04.713629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:04.714581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:04.715053 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:04.715466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:04.716302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:04.716756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:04.718309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.733074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 431/867] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:04.740169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:04.851420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef918e-5c7d-4253-8bec-c06b1cd99b1d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:04.890433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:04.891095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:04.891372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:04.891643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:04.898509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:04.900472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:04.911796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:04.912919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:04.914131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 437/868] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:04.920656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:04.974980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:05.027612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875d7bd-2ee3-478b-92ea-c177ee4700a1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:05.063099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b9ec7-fff0-41d0-bbf3-9eded6c2b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:05.063905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9ec7-fff0-41d0-bbf3-9eded6c2b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:05.064259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9ec7-fff0-41d0-bbf3-9eded6c2b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:05.064603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9ec7-fff0-41d0-bbf3-9eded6c2b6f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:05.065363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b9ec7-fff0-41d0-bbf3-9eded6c2b6f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:05.065737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b9ec7-fff0-41d0-bbf3-9eded6c2b6f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:05.067259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b9ec7-fff0-41d0-bbf3-9eded6c2b6f0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:05.081172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 432/869] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:05.087123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:05.120584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:05.192375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354389-30e8-4282-9a58-5662d57dd946 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:05.227965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a006b57-e180-4a01-98d8-12ab211e3f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:05.228805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006b57-e180-4a01-98d8-12ab211e3f89 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:05.229229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006b57-e180-4a01-98d8-12ab211e3f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:05.229682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006b57-e180-4a01-98d8-12ab211e3f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:05.230416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a006b57-e180-4a01-98d8-12ab211e3f89 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=d3dd402dbe75410aa87c433cbde181c3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:05.230746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a006b57-e180-4a01-98d8-12ab211e3f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:05.232173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a006b57-e180-4a01-98d8-12ab211e3f89 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:05.238782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 438/870] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:05 2022] GET /identity/v3/role_assignments?user.id=d3dd402dbe75410aa87c433cbde181c3&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=45149274288845b0a73e18fbb3394202 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:05.501737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541aba-204b-454d-8200-d62509dac8d5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:05.502016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541aba-204b-454d-8200-d62509dac8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:05.502284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541aba-204b-454d-8200-d62509dac8d5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:05.503888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 433/871] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:05.509258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c1b8-f694-4e94-849a-47282e9e7b22 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:05.509542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c1b8-f694-4e94-849a-47282e9e7b22 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:05.509814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c1b8-f694-4e94-849a-47282e9e7b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:05.529111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f0f0c1b8-f694-4e94-849a-47282e9e7b22 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:05.530343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f0f0c1b8-f694-4e94-849a-47282e9e7b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:05.599647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 439/872] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:05.621979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541aba-204b-454d-8200-d62509dac8d5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:05.724277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541aba-204b-454d-8200-d62509dac8d5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:05.733590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:05.758890 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ddd84-3e8b-4806-b523-2bd436c26d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:05.759424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ddd84-3e8b-4806-b523-2bd436c26d0c None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:05.759699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ddd84-3e8b-4806-b523-2bd436c26d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:05.759968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ddd84-3e8b-4806-b523-2bd436c26d0c None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:05.760617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ddd84-3e8b-4806-b523-2bd436c26d0c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:05.761974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ddd84-3e8b-4806-b523-2bd436c26d0c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:05.833807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 434/873] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:24:05 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:06.443714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fc51-e853-4a75-ae9c-ee2e5e9b8ae6 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:06.444984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fc51-e853-4a75-ae9c-ee2e5e9b8ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:06.446021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fc51-e853-4a75-ae9c-ee2e5e9b8ae6 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:06.447835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 440/874] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:06.453141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e070-0048-459e-92ed-efe00639ea93 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:06.453763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e070-0048-459e-92ed-efe00639ea93 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:06.454257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e070-0048-459e-92ed-efe00639ea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:06.473125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7bc5e070-0048-459e-92ed-efe00639ea93 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:06.474639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7bc5e070-0048-459e-92ed-efe00639ea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:06.556867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 435/875] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:06.579381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fc51-e853-4a75-ae9c-ee2e5e9b8ae6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:06.605332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:06.683195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fc51-e853-4a75-ae9c-ee2e5e9b8ae6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:06.718251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d8b4b-d568-4271-8fba-8eb0d33ad60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:06.719135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d8b4b-d568-4271-8fba-8eb0d33ad60b None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:06.719608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d8b4b-d568-4271-8fba-8eb0d33ad60b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:06.720126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d8b4b-d568-4271-8fba-8eb0d33ad60b None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:06.720974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d8b4b-d568-4271-8fba-8eb0d33ad60b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:06.722548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d8b4b-d568-4271-8fba-8eb0d33ad60b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:06.799237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 441/876] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:24:06 2022] POST /identity/v3/services => generated 269 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:06.907858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb37ea-b57b-451b-85d3-96d7f2333337 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:06.908407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb37ea-b57b-451b-85d3-96d7f2333337 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:06.908407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb37ea-b57b-451b-85d3-96d7f2333337 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:06.910066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 436/877] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:06.915731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f8ef0-dc1d-4f6c-bd01-c34dcaf3a664 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:06.916315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f8ef0-dc1d-4f6c-bd01-c34dcaf3a664 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:06.916816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f8ef0-dc1d-4f6c-bd01-c34dcaf3a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:06.937690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3f5f8ef0-dc1d-4f6c-bd01-c34dcaf3a664 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:06.939313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3f5f8ef0-dc1d-4f6c-bd01-c34dcaf3a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:07.026441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 442/878] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:07.048978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb37ea-b57b-451b-85d3-96d7f2333337 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:07.149644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:07.157138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb37ea-b57b-451b-85d3-96d7f2333337 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:07.192270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7076c0-51cb-49cc-a996-76dc8a3d5aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:07.193278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7076c0-51cb-49cc-a996-76dc8a3d5aec None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.194089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7076c0-51cb-49cc-a996-76dc8a3d5aec None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.194641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7076c0-51cb-49cc-a996-76dc8a3d5aec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.205812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7076c0-51cb-49cc-a996-76dc8a3d5aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6a7076c0-51cb-49cc-a996-76dc8a3d5aec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:07.210546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:07.212026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:07.212852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:07.217370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 437/879] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 10 08:24:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:07.219620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f8ef0-dc1d-4f6c-bd01-c34dcaf3a664 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:07.232373 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:07.324734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f8ef0-dc1d-4f6c-bd01-c34dcaf3a664 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:07.338212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616103-b598-4bd5-98de-928f54b18d9c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.338528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616103-b598-4bd5-98de-928f54b18d9c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.338887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616103-b598-4bd5-98de-928f54b18d9c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.340405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 438/880] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:07.345254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d162-fed8-48d2-8655-c9f758c6ec43 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.345534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d162-fed8-48d2-8655-c9f758c6ec43 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.345807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d162-fed8-48d2-8655-c9f758c6ec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.364045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:07.365046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.365528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.365999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.366852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4316d162-fed8-48d2-8655-c9f758c6ec43 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:07.367141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:07.367686 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:07.368058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4316d162-fed8-48d2-8655-c9f758c6ec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:07.369464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:07.378433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 443/881] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 10 08:24:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:07.390509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:07.456224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 439/882] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:07.474934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:07.478038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316d162-fed8-48d2-8655-c9f758c6ec43 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:07.519522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c163-ed78-48e3-87a5-b78d7ad2824c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:07.569810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:07.571042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.571298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.571568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.577338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:07.588657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:07.593466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:07.594313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316d162-fed8-48d2-8655-c9f758c6ec43 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:07.609081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:07.610098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:07.611035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:07.611035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:07.611035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:07.614545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 444/883] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:07.618001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:07.638497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:07.639154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.639427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.639695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.640273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:07.641623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:07.650453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:07.651476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:07.652334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:07.656559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 440/884] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:07.657841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:07.750721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1be1e9-1d41-44f1-9457-44e226cddcee None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:07.776871 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:07.787527 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:07.788216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.788556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.788986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.789722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:07.790089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:07.790354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c414a1-7660-4620-a9a0-1071a17026b1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:07.791607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:07.804383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 445/885] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:07.811246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:07.835704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:07.836648 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.837571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.838060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.839206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:07.839739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:07.842056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:07.848971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 441/886] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:07.855698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:07.874275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:07.945244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972d60d-0946-4a6e-a93c-4832d3baadaf None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:07.976579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16660808-cb5a-4566-8bbb-c9aa993fbb6a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:07.980936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d30d25-d8ca-4c69-a4cc-5a4e83282e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:07.981559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d30d25-d8ca-4c69-a4cc-5a4e83282e1b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:07.981838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d30d25-d8ca-4c69-a4cc-5a4e83282e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:07.982151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d30d25-d8ca-4c69-a4cc-5a4e83282e1b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:07.990133 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d30d25-d8ca-4c69-a4cc-5a4e83282e1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:07.991853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d30d25-d8ca-4c69-a4cc-5a4e83282e1b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-03d30d25-d8ca-4c69-a4cc-5a4e83282e1b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:08.004436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:08.005395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:24:08.006367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:08.010280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 446/887] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:24:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:08.011506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672bb3-8bba-48bd-8895-feaa1a99a81d None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.011781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672bb3-8bba-48bd-8895-feaa1a99a81d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.012045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672bb3-8bba-48bd-8895-feaa1a99a81d None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.014508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 447/888] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:08.014508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672bb3-8bba-48bd-8895-feaa1a99a81d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.016088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce91b90-33e2-4e09-9fe1-26b0d7985060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:08.016854 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91b90-33e2-4e09-9fe1-26b0d7985060 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.017255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91b90-33e2-4e09-9fe1-26b0d7985060 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.017408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce91b90-33e2-4e09-9fe1-26b0d7985060 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.018012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce91b90-33e2-4e09-9fe1-26b0d7985060 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:08.018310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce91b90-33e2-4e09-9fe1-26b0d7985060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:08.019694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce91b90-33e2-4e09-9fe1-26b0d7985060 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.024545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 442/889] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:08.025539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d3a57-cf30-432f-904b-e741389d9cdd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.025817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d3a57-cf30-432f-904b-e741389d9cdd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.026081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d3a57-cf30-432f-904b-e741389d9cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.045589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f14d3a57-cf30-432f-904b-e741389d9cdd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:08.046841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f14d3a57-cf30-432f-904b-e741389d9cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:08.087213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:08.134926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 443/890] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:08.157048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d3a57-cf30-432f-904b-e741389d9cdd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.163212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672bb3-8bba-48bd-8895-feaa1a99a81d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:08.168052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:08.208525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:08.209460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.209745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.210017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.210793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:08.211141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:08.213204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.242976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 448/891] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:08.245700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.285318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d3a57-cf30-432f-904b-e741389d9cdd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:08.328169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:08.328799 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.329080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.329395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.330028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:08.331403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:08.341100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:08.342095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:08.342986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 444/892] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:08.351157 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.379371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cda3f2-a193-4ef2-99a3-2daca53dfafe None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:08.381054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:08.426421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f060a-2602-4104-a80f-7eec2d4d3a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:08.427060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f060a-2602-4104-a80f-7eec2d4d3a3f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.427383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f060a-2602-4104-a80f-7eec2d4d3a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.427675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f060a-2602-4104-a80f-7eec2d4d3a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.446800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:08.479715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56739e2-e188-4e61-aae6-5a3f51bb92f9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:08.516231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:08.517258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.517776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.518257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.519132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:08.519649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:08.521273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.524109 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f060a-2602-4104-a80f-7eec2d4d3a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:08.525558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f060a-2602-4104-a80f-7eec2d4d3a3f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.532451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 445/893] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:08.533576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.640374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62c9a-330d-4819-9211-ba22c46e3037 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:08.663062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 449/894] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 08:24:08.669370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f060a-2602-4104-a80f-7eec2d4d3a3f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.677262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:08.688711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:08.689525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.689956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.690882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.691150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:08.691460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:08.694183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.696859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:08.705648 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 446/895] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:08.707391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.777966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f060a-2602-4104-a80f-7eec2d4d3a3f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:08.811922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97213ea3-784b-4e08-b486-7c1a2a5b8a7c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:08.814213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:08.815464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.815464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.815464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.827051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:08.828672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:08.846609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:08.847589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:08.848482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:08.848482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:08.848482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:08.850601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 450/896] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:08.853179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:08.853783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:08.854058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:08.854323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:08.855312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.856232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] RBAC: Adding query filter params (interface=public, service_id=266c33f00adf4b57b89c985ec21b6a1f, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:08.856533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:08.857881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:08.868242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 447/897] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/endpoints?service_id=266c33f00adf4b57b89c985ec21b6a1f&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:08.869143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:08.921458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:08.936860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:08.971238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15879e65-ecb0-48a5-abd8-14375cc4f92d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:08.981741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c513a-4d59-4833-a592-46e2f80f4e94 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:09.006447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c0500-c11d-418e-a4b8-c79585e1463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.007076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0500-c11d-418e-a4b8-c79585e1463a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.007359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0500-c11d-418e-a4b8-c79585e1463a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.007632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0500-c11d-418e-a4b8-c79585e1463a None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.008790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0500-c11d-418e-a4b8-c79585e1463a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:09.009093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0500-c11d-418e-a4b8-c79585e1463a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.010506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0500-c11d-418e-a4b8-c79585e1463a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.021253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ce3a-edfb-428e-b023-cf221f873cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.021866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ce3a-edfb-428e-b023-cf221f873cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.027424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ce3a-edfb-428e-b023-cf221f873cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.027551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 451/898] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:09.027633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ce3a-edfb-428e-b023-cf221f873cd3 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.027633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5ce3a-edfb-428e-b023-cf221f873cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.027780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8628-948e-4570-ac03-325341a92d6a None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.027780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8628-948e-4570-ac03-325341a92d6a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.027780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8628-948e-4570-ac03-325341a92d6a None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.027974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5ce3a-edfb-428e-b023-cf221f873cd3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.028043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 452/899] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:09.028043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb8628-948e-4570-ac03-325341a92d6a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:09.042957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 448/900] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:24:08 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:24:09.044437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497c6d-1cfd-428b-a73b-69d32946f9e2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.044725 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497c6d-1cfd-428b-a73b-69d32946f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.045003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497c6d-1cfd-428b-a73b-69d32946f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.067958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cb497c6d-1cfd-428b-a73b-69d32946f9e2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:09.069461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cb497c6d-1cfd-428b-a73b-69d32946f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:09.148696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb8628-948e-4570-ac03-325341a92d6a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:09.154993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 449/901] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:09.168885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:09.174565 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497c6d-1cfd-428b-a73b-69d32946f9e2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:09.193195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.193830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.194110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.194677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.204386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.205831 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:09.219016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:09.220796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:09.221943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 453/902] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:09.226751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:09.246898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:09.302820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497c6d-1cfd-428b-a73b-69d32946f9e2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:09.345987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797df7a-5298-40de-98b9-a5b75e763e5e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:09.348319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.349845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.350128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.350407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.351023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.352432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:09.366272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:09.368034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:09.369247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 450/903] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Aug 10 08:24:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:09.376333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:09.390530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.391231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.391577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.391940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.392705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:09.393098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.394627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.407575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 454/904] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:09.413195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:09.459632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:09.494344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbb0a3-5c4a-4e42-842f-5dd65d8d0447 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:09.517554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:09.532548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.533522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.534011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.534521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.535363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:09.535932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.537579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.547915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ca927-1cae-4d4b-9ce8-9500ef156e50 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:09.548632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 451/905] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:09.550769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:09.586225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.586831 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.587111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.587385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.588116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] RBAC: Adding query filter params (role.id=a132edd9902c4f9dab5c096b57b0f2bd, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=d79837cddc7b4e4dbf0dbe16d50fa0fa) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:09.588425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.590056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.596249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 455/906] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:09 2022] GET /identity/v3/role_assignments?user.id=d79837cddc7b4e4dbf0dbe16d50fa0fa&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=a132edd9902c4f9dab5c096b57b0f2bd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:09.670232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb99bb-7e4b-4886-8626-58695d10ffd9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:09.709877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.710888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.711387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.711807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.712615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:09.713068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.714665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.725585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 452/907] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:09.731643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:09.838482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:09.843029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50507fe-3469-4dfe-95b8-4209d069a974 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:09.877789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426e143-c223-4832-b869-9ca4dfe0fa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:09.878401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e143-c223-4832-b869-9ca4dfe0fa0a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:09.878711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e143-c223-4832-b869-9ca4dfe0fa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:09.878982 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426e143-c223-4832-b869-9ca4dfe0fa0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:09.879689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426e143-c223-4832-b869-9ca4dfe0fa0a None admin] RBAC: Adding query filter params (interface=public, service_id=0f05864d0fb0496ca447eeef2fac82d7, region_id=RegionOne) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:09.879997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426e143-c223-4832-b869-9ca4dfe0fa0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:09.881361 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426e143-c223-4832-b869-9ca4dfe0fa0a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:09.886932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 456/908] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 10 08:24:09 2022] GET /identity/v3/endpoints?service_id=0f05864d0fb0496ca447eeef2fac82d7&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:09.893027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:09.956638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:10.009721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd48e8-60fb-484e-83d8-90cc7457da74 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:10.046852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902266eb-7b9e-460d-91b4-4737d43245a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:10.047464 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902266eb-7b9e-460d-91b4-4737d43245a9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:10.047746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902266eb-7b9e-460d-91b4-4737d43245a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:10.048039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902266eb-7b9e-460d-91b4-4737d43245a9 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:10.048654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902266eb-7b9e-460d-91b4-4737d43245a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:10.050014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902266eb-7b9e-460d-91b4-4737d43245a9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:10.056474 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 453/909] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:24:09 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:24:10.081607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9642e7-bd8c-400a-9f2f-4778a9762478 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:10.081929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9642e7-bd8c-400a-9f2f-4778a9762478 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:10.082166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9642e7-bd8c-400a-9f2f-4778a9762478 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:10.083606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 457/910] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:10.089887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110100-0f17-4d2a-86bd-4f6ecf228370 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:10.090187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110100-0f17-4d2a-86bd-4f6ecf228370 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:10.090431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110100-0f17-4d2a-86bd-4f6ecf228370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:10.112554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-03110100-0f17-4d2a-86bd-4f6ecf228370 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:10.113853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03110100-0f17-4d2a-86bd-4f6ecf228370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:10.191917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 454/911] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:10.216966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9642e7-bd8c-400a-9f2f-4778a9762478 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:10.334264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9642e7-bd8c-400a-9f2f-4778a9762478 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:10.369591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cb760-008a-406a-b134-f0d46a13602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:10.370201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb760-008a-406a-b134-f0d46a13602d None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:10.370493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb760-008a-406a-b134-f0d46a13602d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:10.370786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb760-008a-406a-b134-f0d46a13602d None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:10.371570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cb760-008a-406a-b134-f0d46a13602d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:10.372937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cb760-008a-406a-b134-f0d46a13602d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:10.439253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 458/912] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:24:10 2022] POST /identity/v3/services => generated 241 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:11.178615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac21d2-1407-4840-8b9e-c7766039e3d8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.179316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac21d2-1407-4840-8b9e-c7766039e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.179316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac21d2-1407-4840-8b9e-c7766039e3d8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.181325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 455/913] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:11.186743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77667d3e-9b53-4636-b075-feed0a75bbfc None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.187225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77667d3e-9b53-4636-b075-feed0a75bbfc None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.187409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77667d3e-9b53-4636-b075-feed0a75bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.213670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-77667d3e-9b53-4636-b075-feed0a75bbfc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:11.213670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-77667d3e-9b53-4636-b075-feed0a75bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:11.225129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:11.285440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 459/914] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:11.308796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac21d2-1407-4840-8b9e-c7766039e3d8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:11.356726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:11.416030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac21d2-1407-4840-8b9e-c7766039e3d8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:11.451416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:11.452043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.452317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.452591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.453224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:11.454616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:11.463863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:11.464828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:11.465977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 456/915] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:11.471187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77667d3e-9b53-4636-b075-feed0a75bbfc None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:11.575148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77667d3e-9b53-4636-b075-feed0a75bbfc None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:11.611915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ed17b-121e-4486-8f8f-1f0eb2f88b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:11.612582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed17b-121e-4486-8f8f-1f0eb2f88b0a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.612861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed17b-121e-4486-8f8f-1f0eb2f88b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.613128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed17b-121e-4486-8f8f-1f0eb2f88b0a None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.613765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ed17b-121e-4486-8f8f-1f0eb2f88b0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:11.614068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ed17b-121e-4486-8f8f-1f0eb2f88b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:11.615466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ed17b-121e-4486-8f8f-1f0eb2f88b0a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:11.620602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 460/916] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:11.626357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:11.655606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c2d7-34c4-4910-9600-7830da9d0799 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.655907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c2d7-34c4-4910-9600-7830da9d0799 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.656162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c2d7-34c4-4910-9600-7830da9d0799 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.657776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 461/917] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:11.663320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c78410-ced6-49ef-83bb-cc4990160b48 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.663705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c78410-ced6-49ef-83bb-cc4990160b48 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.664631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c78410-ced6-49ef-83bb-cc4990160b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.682518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-30c78410-ced6-49ef-83bb-cc4990160b48 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:11.683827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-30c78410-ced6-49ef-83bb-cc4990160b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:11.691423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:11.738451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d799e-1f90-40ee-9335-eeac0b309258 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:11.746334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:11.762589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 462/918] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:11.776303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:11.777381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.777832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c78410-ced6-49ef-83bb-cc4990160b48 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:11.778311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.778851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.779669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:11.780259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:11.781902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:11.787728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 457/919] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 10 08:24:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:11.794537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:11.885872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c78410-ced6-49ef-83bb-cc4990160b48 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:11.906499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52336d8a-40f3-4f18-941a-45ccdf658a3c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:11.921287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56b526-e300-4aed-9459-29a4f51e4663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:11.921927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56b526-e300-4aed-9459-29a4f51e4663 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.922210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56b526-e300-4aed-9459-29a4f51e4663 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.922540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56b526-e300-4aed-9459-29a4f51e4663 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.935730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56b526-e300-4aed-9459-29a4f51e4663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:11.938597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3db0-9d25-47f6-81b5-511e3a19377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:11.942029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3db0-9d25-47f6-81b5-511e3a19377a None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:11.942029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3db0-9d25-47f6-81b5-511e3a19377a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:11.942029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3db0-9d25-47f6-81b5-511e3a19377a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:11.942029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3db0-9d25-47f6-81b5-511e3a19377a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-0c56b526-e300-4aed-9459-29a4f51e4663 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:11.942348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:11.943231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:11.944078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:11.944979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3db0-9d25-47f6-81b5-511e3a19377a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:11.950609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 463/920] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 10 08:24:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:11.950609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56b526-e300-4aed-9459-29a4f51e4663 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:11.955763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:12.052783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56b526-e300-4aed-9459-29a4f51e4663 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:12.069716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 458/921] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:24:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:12.105786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cbe9f-5b66-447b-9053-edc1a994eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:12.106871 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cbe9f-5b66-447b-9053-edc1a994eca1 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.107374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cbe9f-5b66-447b-9053-edc1a994eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.107965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cbe9f-5b66-447b-9053-edc1a994eca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.108934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cbe9f-5b66-447b-9053-edc1a994eca1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:12.109438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cbe9f-5b66-447b-9053-edc1a994eca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:12.111074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cbe9f-5b66-447b-9053-edc1a994eca1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:12.122414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 464/922] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 10 08:24:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:12.127811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3db0-9d25-47f6-81b5-511e3a19377a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:12.162203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:12.257678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3db0-9d25-47f6-81b5-511e3a19377a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:12.291592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee21d17-f7fb-41d1-b469-dedb0c75c306 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.292132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee21d17-f7fb-41d1-b469-dedb0c75c306 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.292213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee21d17-f7fb-41d1-b469-dedb0c75c306 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.294794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 465/923] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:12.299997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309da57-ec0e-436a-a081-f19d63f636b8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.300283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309da57-ec0e-436a-a081-f19d63f636b8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.300554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309da57-ec0e-436a-a081-f19d63f636b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.301487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:12.302121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.302393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.302693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.314994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:12.316377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:12.326703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8309da57-ec0e-436a-a081-f19d63f636b8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:12.328237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8309da57-ec0e-436a-a081-f19d63f636b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:12.339921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:12.340973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:12.341923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:12.341923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:12.341923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:12.343933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 459/924] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:12.350487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:12.402403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:12.402777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 466/925] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:12.425818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309da57-ec0e-436a-a081-f19d63f636b8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:12.436650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:12.468094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596890-e367-41f7-9795-e4033f5fe6eb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:12.504874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf4df1-9c6a-4d76-9482-a6ea5b9bfd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:12.505483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf4df1-9c6a-4d76-9482-a6ea5b9bfd07 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.505762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf4df1-9c6a-4d76-9482-a6ea5b9bfd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.506032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf4df1-9c6a-4d76-9482-a6ea5b9bfd07 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.506711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf4df1-9c6a-4d76-9482-a6ea5b9bfd07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:12.507012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf4df1-9c6a-4d76-9482-a6ea5b9bfd07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:12.508418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf4df1-9c6a-4d76-9482-a6ea5b9bfd07 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:12.522001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 460/926] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:12.523291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec245d-47c3-44b1-847e-1491ccab27d4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.523603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec245d-47c3-44b1-847e-1491ccab27d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.523876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec245d-47c3-44b1-847e-1491ccab27d4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.525345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 461/927] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:12.526964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec245d-47c3-44b1-847e-1491ccab27d4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:12.551136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309da57-ec0e-436a-a081-f19d63f636b8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:12.586820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9e999-5953-4c33-b92e-013a2bc1343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:12.587368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9e999-5953-4c33-b92e-013a2bc1343e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.587651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9e999-5953-4c33-b92e-013a2bc1343e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.587921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9e999-5953-4c33-b92e-013a2bc1343e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.588506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9e999-5953-4c33-b92e-013a2bc1343e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:12.589870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9e999-5953-4c33-b92e-013a2bc1343e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-0ce9e999-5953-4c33-b92e-013a2bc1343e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:12.598458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:12.599450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:12.600353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 467/928] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Aug 10 08:24:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:12.601177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7668eb-b98d-4906-948e-96f98fb9aa52 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.601177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7668eb-b98d-4906-948e-96f98fb9aa52 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.601300 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7668eb-b98d-4906-948e-96f98fb9aa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.620573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-0c7668eb-b98d-4906-948e-96f98fb9aa52 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:12.621770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0c7668eb-b98d-4906-948e-96f98fb9aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:12.644235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec245d-47c3-44b1-847e-1491ccab27d4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:12.673648 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:12.682236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:12.688853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.688853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.688853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.690899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:12.691546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 468/929] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:12.692180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7668eb-b98d-4906-948e-96f98fb9aa52 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:12.703706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:12.708247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:12.720368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:12.723730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 462/930] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:24:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:12.724702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:12.810394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7668eb-b98d-4906-948e-96f98fb9aa52 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:12.828038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd4653-1513-4198-b4f2-ef79564b3b65 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:12.846307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:12.846868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.847145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.847414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.848050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:12.848389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:12.849759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:12.855222 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 469/931] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:12.855222 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:12.869870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:12.870695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:12.871027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:12.871301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:12.871882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:12.873230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:12.882536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:12.883568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:12.884424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 463/932] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:12.885267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:12.915459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:12.954215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:12.970547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2b67-57b1-49ef-b2a4-c2c868bec2ea None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:12.994054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8ab7-e545-4da8-ac90-4f6e76e404a3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.011896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.012490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.012767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.013033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.013808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:13.014307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.015581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.029245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.029850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.030127 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.030391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.031056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:13.031359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.032708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.034247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 470/933] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 10 08:24:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:13.034900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.046595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 464/934] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:13.046595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.140537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fa6c4-e039-4d52-8fd2-c4d26980bf95 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.147664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:13.152081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e94cd-074a-47eb-b8e9-ab09a6cbef43 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.175597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.176195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.176469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.176790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.177413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:13.177785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.180211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:13.180557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.186605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 471/935] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:13.187261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.193768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.194692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.194973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.195275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.206602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.208060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:13.223243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:13.224429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:13.225388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:13.225388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:13.225388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:13.225388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 465/936] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:13.225388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.296480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc46b-e248-4355-bf0d-86913f371734 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.331624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e0b56-b69c-4a85-960c-1930e1dbea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.332091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d23cf-60ef-4897-b0be-3a3fdd6746e7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.332543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0b56-b69c-4a85-960c-1930e1dbea0c None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.332543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0b56-b69c-4a85-960c-1930e1dbea0c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.332787 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0b56-b69c-4a85-960c-1930e1dbea0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.333379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e0b56-b69c-4a85-960c-1930e1dbea0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.334760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e0b56-b69c-4a85-960c-1930e1dbea0c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.367216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.367818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.368092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.368360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.368984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:13.369285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.370681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.375405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 466/937] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:13.376164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.419637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:13.442972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 472/938] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:24:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:13.447556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e0b56-b69c-4a85-960c-1930e1dbea0c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.487270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:13.494345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee8339-122d-4011-9a60-e02539ccb669 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.554301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.556173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.556451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.556756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.557426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:13.557723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.559683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.577234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 467/939] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:13.583503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.595920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e0b56-b69c-4a85-960c-1930e1dbea0c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.641393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.642767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.643267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.644037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.645328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] RBAC: Adding query filter params (interface=public, service_id=9ac19a97c49d469b9a40963f43ebb2ac, region_id=RegionOne) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:13.645834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.647498 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.653710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 473/940] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 10 08:24:13 2022] GET /identity/v3/endpoints?service_id=9ac19a97c49d469b9a40963f43ebb2ac&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:13.659929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.707536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:13.712827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783575cf-673a-431d-869d-c06e1b390702 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.751230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.752315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.752832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.753317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.761128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.762910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:13.774712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:13.775636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:13.776522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:13.776522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:13.776522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:13.776522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:13.776522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:13.776522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:13.776522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:13.776522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:13.783078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780a15c-92d7-4293-8fb8-9734757527ee None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.783078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:13.783808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 468/941] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:13.785564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:13.821877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815fc6-637f-4627-a6b0-1160bfb68aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.822504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815fc6-637f-4627-a6b0-1160bfb68aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.822981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815fc6-637f-4627-a6b0-1160bfb68aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.823252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815fc6-637f-4627-a6b0-1160bfb68aa0 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.823862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815fc6-637f-4627-a6b0-1160bfb68aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.825406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815fc6-637f-4627-a6b0-1160bfb68aa0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.834548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 474/942] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:24:13 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:24:13.906217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc96c01-35e0-4fb7-a0db-fffa2227fa76 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:13.959487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f95ec-478e-4c9d-805e-d5dc319f8202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:13.960604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f95ec-478e-4c9d-805e-d5dc319f8202 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:13.961662 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f95ec-478e-4c9d-805e-d5dc319f8202 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:13.962141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f95ec-478e-4c9d-805e-d5dc319f8202 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:13.963092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f95ec-478e-4c9d-805e-d5dc319f8202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:13.963604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f95ec-478e-4c9d-805e-d5dc319f8202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:13.965250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f95ec-478e-4c9d-805e-d5dc319f8202 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:13.982622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 469/943] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:13.985336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815fc6-637f-4627-a6b0-1160bfb68aa0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:14.096457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815fc6-637f-4627-a6b0-1160bfb68aa0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:14.131092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fb7d6-dd3b-4d84-ac81-dfb4238ba573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:14.132186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb7d6-dd3b-4d84-ac81-dfb4238ba573 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:14.133190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb7d6-dd3b-4d84-ac81-dfb4238ba573 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:14.133698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb7d6-dd3b-4d84-ac81-dfb4238ba573 None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/d79837cddc7b4e4dbf0dbe16d50fa0fa/roles/a132edd9902c4f9dab5c096b57b0f2bd` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:14.136113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb7d6-dd3b-4d84-ac81-dfb4238ba573 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=d79837cddc7b4e4dbf0dbe16d50fa0fa, role_id=a132edd9902c4f9dab5c096b57b0f2bd)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:14.137853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb7d6-dd3b-4d84-ac81-dfb4238ba573 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:14.192434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bec83-be0b-4ecf-8659-ab7271aaa57d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:14.192795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bec83-be0b-4ecf-8659-ab7271aaa57d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:14.192989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bec83-be0b-4ecf-8659-ab7271aaa57d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:14.194970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 470/944] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:14.200128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e192b-d625-4900-8178-8456c43c6809 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:14.200407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e192b-d625-4900-8178-8456c43c6809 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:14.200736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e192b-d625-4900-8178-8456c43c6809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:14.219165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 475/945] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:24:13 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/d79837cddc7b4e4dbf0dbe16d50fa0fa/roles/a132edd9902c4f9dab5c096b57b0f2bd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:14.228039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-431e192b-d625-4900-8178-8456c43c6809 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:14.229268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-431e192b-d625-4900-8178-8456c43c6809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:14.253542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:14.317501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 471/946] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:14.341314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fb7d6-dd3b-4d84-ac81-dfb4238ba573 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:14.362925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:14.453922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fb7d6-dd3b-4d84-ac81-dfb4238ba573 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:14.489771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:14.490301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:14.490608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:14.490879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:14.491576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:14.493078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:14.495759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING keystone.server.flask.common [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 08:24:14.541189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.sql.core [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 08:24:14.541189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 08:24:14.541189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [parameters: {'id': '2f2a989fe96d43478b6fc777cd700b1a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 08:24:14.541189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f2a989fe96d43478b6fc777cd700b1a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f2a989fe96d43478b6fc777cd700b1a. Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application conn.query(q) Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 08:24:14.548466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application result.read() Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 08:24:14.549262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application next(self.gen) Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application yield resource Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application next(self.gen) Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise self.value Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application session.commit() Aug 10 08:24:14.550206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.session.flush() Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application compat.raise_( Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 08:24:14.551121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 08:24:14.552033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application conn.query(q) Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application result.read() Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 08:24:14.554350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [parameters: {'id': '2f2a989fe96d43478b6fc777cd700b1a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:14.556476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:14.558321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f2a989fe96d43478b6fc777cd700b1a. Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:14.560440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 476/947] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Aug 10 08:24:14 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:14.567496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e192b-d625-4900-8178-8456c43c6809 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:14.674025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e192b-d625-4900-8178-8456c43c6809 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:14.710445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aca14f-bdca-4b0a-9a34-b6ae0832cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:14.711700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca14f-bdca-4b0a-9a34-b6ae0832cef2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:14.711981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca14f-bdca-4b0a-9a34-b6ae0832cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:14.712250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca14f-bdca-4b0a-9a34-b6ae0832cef2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:14.719318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca14f-bdca-4b0a-9a34-b6ae0832cef2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:14.720963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca14f-bdca-4b0a-9a34-b6ae0832cef2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-80aca14f-bdca-4b0a-9a34-b6ae0832cef2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:14.732019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:14.732930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:14.733808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 472/948] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:14.740865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:14.811095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:14.842593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e1ae-590a-4649-828b-447235c23281 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:14.880803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ce069-8fca-42e6-9d1a-23ce2242a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:14.881410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce069-8fca-42e6-9d1a-23ce2242a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:14.881686 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce069-8fca-42e6-9d1a-23ce2242a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:14.882036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce069-8fca-42e6-9d1a-23ce2242a5f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:14.883244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ce069-8fca-42e6-9d1a-23ce2242a5f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:14.883549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ce069-8fca-42e6-9d1a-23ce2242a5f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:14.885178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ce069-8fca-42e6-9d1a-23ce2242a5f0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:14.909981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 477/949] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:24:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:15.500335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb09c79-6b66-46ac-9cbe-ee5dddb513e1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:15.500751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb09c79-6b66-46ac-9cbe-ee5dddb513e1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:15.500931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb09c79-6b66-46ac-9cbe-ee5dddb513e1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:15.502348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 473/950] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:15.507750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968876-d916-4d5b-a7b6-9aaa396a1bcd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:15.508184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968876-d916-4d5b-a7b6-9aaa396a1bcd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:15.508279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968876-d916-4d5b-a7b6-9aaa396a1bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:15.526783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7f968876-d916-4d5b-a7b6-9aaa396a1bcd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:15.528276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7f968876-d916-4d5b-a7b6-9aaa396a1bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:15.599555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 478/951] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:15.622049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb09c79-6b66-46ac-9cbe-ee5dddb513e1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:15.634146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:15.733572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb09c79-6b66-46ac-9cbe-ee5dddb513e1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:15.768817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:15.769418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:15.769695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:15.769965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:15.770573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:15.771938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:15.780733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:15.781885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:15.782857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 474/952] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:15.790607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f968876-d916-4d5b-a7b6-9aaa396a1bcd None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:15.850388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:15.892027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f968876-d916-4d5b-a7b6-9aaa396a1bcd None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:15.928180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97af0a-5809-426d-8e8a-6421d37dcffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:15.928880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97af0a-5809-426d-8e8a-6421d37dcffb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:15.929157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97af0a-5809-426d-8e8a-6421d37dcffb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:15.929467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97af0a-5809-426d-8e8a-6421d37dcffb None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:15.930208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97af0a-5809-426d-8e8a-6421d37dcffb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:15.930578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97af0a-5809-426d-8e8a-6421d37dcffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:15.931937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97af0a-5809-426d-8e8a-6421d37dcffb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:15.937280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 479/953] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:24:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:15.942847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:16.007289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce852f0-2c1c-4ce0-84be-6110aa7067b4 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.007951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce852f0-2c1c-4ce0-84be-6110aa7067b4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.008421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce852f0-2c1c-4ce0-84be-6110aa7067b4 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.010190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 480/954] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:16.015198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991423c-624e-4370-8d37-d74c0b659664 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.015739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991423c-624e-4370-8d37-d74c0b659664 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.016206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991423c-624e-4370-8d37-d74c0b659664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.017531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:16.035003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8991423c-624e-4370-8d37-d74c0b659664 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:16.036478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8991423c-624e-4370-8d37-d74c0b659664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:16.055197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014188e-6114-4c44-b3dd-6f23313bf3a2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:16.096102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:16.096732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.097015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.097325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.097977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:16.098278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:16.100451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:16.113010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 475/955] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:24:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:16.120416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 481/956] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:16.143013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:16.258731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653284a4-f297-42ac-85d6-2fb9c5060bf8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:16.296575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:16.297135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.297413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.297683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.298265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:16.299668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:16.302343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:16.314231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:16.315370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:16.316747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 476/957] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:16.317656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d27be-b079-40b2-a534-1aa56ee0a3be None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.317656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d27be-b079-40b2-a534-1aa56ee0a3be None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.317656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d27be-b079-40b2-a534-1aa56ee0a3be None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.318818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:16.319922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 482/958] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:16.324717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f991e-525e-4ba9-af12-ce16e537ed4b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.324999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f991e-525e-4ba9-af12-ce16e537ed4b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.325267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f991e-525e-4ba9-af12-ce16e537ed4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.355022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-2a0f991e-525e-4ba9-af12-ce16e537ed4b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:16.356282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2a0f991e-525e-4ba9-af12-ce16e537ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:16.413221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:16.438487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 483/959] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:16.453625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d892a-c467-4ac5-9817-d1039c4e4480 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:16.457684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f991e-525e-4ba9-af12-ce16e537ed4b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:16.505524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:16.506277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.506708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.506998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.508155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:16.508458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:16.510002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:16.516380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 477/960] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:16.524029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:16.582441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f991e-525e-4ba9-af12-ce16e537ed4b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:16.601120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:16.625832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00fa11-3dfe-4fff-a3a1-0002cca65fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:16.626225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00fa11-3dfe-4fff-a3a1-0002cca65fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.626607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00fa11-3dfe-4fff-a3a1-0002cca65fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.626884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00fa11-3dfe-4fff-a3a1-0002cca65fa5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.638508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00fa11-3dfe-4fff-a3a1-0002cca65fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-db00fa11-3dfe-4fff-a3a1-0002cca65fa5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:16.644272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:16.645316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:16.651128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 484/961] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 10 08:24:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:16.652530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00fa11-3dfe-4fff-a3a1-0002cca65fa5 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:16.661005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d9b51-56df-4d2a-b9d3-0668343f6408 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:16.709282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:16.710052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.710426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.711267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.712280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:16.712689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:16.714275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:16.715486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:16.722689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 478/962] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:16.727625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:16.774056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00fa11-3dfe-4fff-a3a1-0002cca65fa5 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:16.822286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:16.823037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.823381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.823723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.824937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:16.825312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:16.827190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:16.842947 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 485/963] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 10 08:24:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:16.845054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:16.860387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54c46-58af-4aaf-949f-c72308f2b6ca None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:16.890857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:16.899911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cffc4-dc3e-462b-bf56-0c8053aec533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:16.904782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cffc4-dc3e-462b-bf56-0c8053aec533 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:16.904782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cffc4-dc3e-462b-bf56-0c8053aec533 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:16.904782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cffc4-dc3e-462b-bf56-0c8053aec533 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:16.904782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cffc4-dc3e-462b-bf56-0c8053aec533 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:16.904782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cffc4-dc3e-462b-bf56-0c8053aec533 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:16.974728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c470b-c9c4-44c1-a3de-e07da4ded202 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:16.982719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:16.994793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 479/964] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:24:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:24:17.021306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:17.022003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.022288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.022591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.035088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:17.036709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:17.046333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8e9d-50e6-4c94-bce3-7520e4f1412a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.046708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8e9d-50e6-4c94-bce3-7520e4f1412a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.046915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8e9d-50e6-4c94-bce3-7520e4f1412a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.048569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 480/965] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:17.054199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0120-68d4-42a9-9e81-a7b3e38b739e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.055080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0120-68d4-42a9-9e81-a7b3e38b739e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.055363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b0120-68d4-42a9-9e81-a7b3e38b739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:17.055810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:17.056953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:17.058062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:17.058062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:17.058062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:17.063348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 486/966] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:17.064759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:17.075306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fe0b0120-68d4-42a9-9e81-a7b3e38b739e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:17.076894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fe0b0120-68d4-42a9-9e81-a7b3e38b739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:17.176220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 481/967] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:17.186340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76e174-7bd3-4535-9e72-991f925c8383 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:17.201089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b0120-68d4-42a9-9e81-a7b3e38b739e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:17.229204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:17.242834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.242834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.242834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.242834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:17.242834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:17.242834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:17.247262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 487/968] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:17.256189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:17.270337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:17.308199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b0120-68d4-42a9-9e81-a7b3e38b739e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:17.322899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:17.352487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:17.353192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.353740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.354012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.354666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:17.357085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:17.360671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING keystone.server.flask.common [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 08:24:17.365121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae87913-739b-4199-a811-4ab70291b7c0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:17.401744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:17.402447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.402752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.403026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.410577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:17.412025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:17.416212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.sql.core [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 08:24:17.416212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 08:24:17.416212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [parameters: {'user_id': 'f7b465a78fb747cc84b1b509448891bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 08:24:17.416212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:17.425104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:17.431647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 488/969] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:24:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:17.432905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application conn.query(q) Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application result.read() Aug 10 08:24:17.437912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 08:24:17.439039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application next(self.gen) Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application yield resource Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application next(self.gen) Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise self.value Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application session.commit() Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 08:24:17.440304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.session.flush() Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application compat.raise_( Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 08:24:17.441429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 08:24:17.446558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application conn.query(q) Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application result.read() Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 08:24:17.447503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f7b465a78fb747cc84b1b509448891bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:17.448434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 08:24:17.449432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 08:24:17.454929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 08:24:17.454929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 08:24:17.454929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 08:24:17.454929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 08:24:17.454929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 08:24:17.454929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:17.454929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 482/970] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 10 08:24:17 2022] POST /identity/v3/users => generated 160 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:17.454929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:17.517689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:17.545852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e79538-a3b7-432f-9bc0-f3560164c5b3 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:17.561100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e2f14-f9ff-48ae-9e2e-7d0829739077 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:17.583046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:17.583711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.583996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.584314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.585150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:17.585456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:17.587483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:17.600081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:17.600739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.601014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.601872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.609602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:17.610701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 489/971] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 10 08:24:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:17.611290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:17.612846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:17.623532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:17.625689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 08:24:17.628062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:17.629608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 483/972] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:24:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:17.634496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:17.668507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:17.721633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3935bd2-99f9-4195-8dd1-cd75bbbdcb2f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:17.739218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d3526-e780-4b8d-a64a-9b5119af547f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:17.753876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:17.759389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644edd73-aa41-4844-b689-5822c9bbf96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:17.760045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644edd73-aa41-4844-b689-5822c9bbf96f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.760326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644edd73-aa41-4844-b689-5822c9bbf96f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.760597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644edd73-aa41-4844-b689-5822c9bbf96f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.779563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:17.780449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:17.780881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:17.781304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:17.782150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:17.782657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:17.784242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:17.834493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644edd73-aa41-4844-b689-5822c9bbf96f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:17.835056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644edd73-aa41-4844-b689-5822c9bbf96f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:17.835226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 484/973] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 10 08:24:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:17.962556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 490/974] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 08:24:17.964267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:18.064917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:18.072644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26820ba-2863-4b62-bf80-d4439bec07dc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:18.110552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f8b13-d937-4d14-80da-acd1fd239f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:18.110910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f8b13-d937-4d14-80da-acd1fd239f8b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:18.112111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f8b13-d937-4d14-80da-acd1fd239f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:18.112111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f8b13-d937-4d14-80da-acd1fd239f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:18.123709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f8b13-d937-4d14-80da-acd1fd239f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:18.125193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f8b13-d937-4d14-80da-acd1fd239f8b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-913f8b13-d937-4d14-80da-acd1fd239f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:18.140409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:18.141490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:18.142450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:18.142450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:18.142450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:18.143155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 485/975] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:18.147530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644edd73-aa41-4844-b689-5822c9bbf96f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:18.158178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642da41c-eda1-4890-b1b9-b2cfd4c9073e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:18.158587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642da41c-eda1-4890-b1b9-b2cfd4c9073e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:18.158858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642da41c-eda1-4890-b1b9-b2cfd4c9073e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:18.160472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 486/976] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:18.165841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e7632-8289-496a-8530-321c2a034f05 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:18.166132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e7632-8289-496a-8530-321c2a034f05 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:18.166400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e7632-8289-496a-8530-321c2a034f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:18.180068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:18.185684 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f71e7632-8289-496a-8530-321c2a034f05 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:18.193305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f71e7632-8289-496a-8530-321c2a034f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:18.258107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644edd73-aa41-4844-b689-5822c9bbf96f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:18.258332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 487/977] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:18.280994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e7632-8289-496a-8530-321c2a034f05 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:18.300152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:18.300754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:18.301026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:18.301289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:18.301986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:18.302283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:18.303716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:18.319558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 491/978] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:18.322744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:18.364633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:18.387775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e7632-8289-496a-8530-321c2a034f05 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:18.423815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d79e-30d3-43d6-90f8-dfb693c0db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:18.424417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d79e-30d3-43d6-90f8-dfb693c0db51 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:18.424692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d79e-30d3-43d6-90f8-dfb693c0db51 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:18.424960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d79e-30d3-43d6-90f8-dfb693c0db51 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:18.425589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282d79e-30d3-43d6-90f8-dfb693c0db51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:18.426977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282d79e-30d3-43d6-90f8-dfb693c0db51 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:18.430485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:18.439347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249cc74-4773-4ca3-a855-96aaa5b8d468 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:18.472258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:18.472871 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:18.473141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:18.473404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:18.479792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:18.481211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:18.491903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:18.492840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:18.493816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 492/979] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:18.498835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:18.557014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 488/980] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:24:18 2022] POST /identity/v3/services => generated 242 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:24:18.604738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29829b-d2b9-4242-ac54-b11998ef3f9e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:18.649269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1cb3-e7dd-460a-8752-1ab98631b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:18.649882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1cb3-e7dd-460a-8752-1ab98631b174 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:18.650156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1cb3-e7dd-460a-8752-1ab98631b174 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:18.650420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1cb3-e7dd-460a-8752-1ab98631b174 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:18.651142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1cb3-e7dd-460a-8752-1ab98631b174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:18.651448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1cb3-e7dd-460a-8752-1ab98631b174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:18.652892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1cb3-e7dd-460a-8752-1ab98631b174 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:18.671665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 493/981] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:18.673697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d79e-30d3-43d6-90f8-dfb693c0db51 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:18.782251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d79e-30d3-43d6-90f8-dfb693c0db51 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:18.815614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49e39a-612c-4e1b-8787-518f18586503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:18.816310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e39a-612c-4e1b-8787-518f18586503 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:18.816651 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e39a-612c-4e1b-8787-518f18586503 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:18.816984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e39a-612c-4e1b-8787-518f18586503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:18.817782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49e39a-612c-4e1b-8787-518f18586503 None admin] RBAC: Adding query filter params (role.id=a132edd9902c4f9dab5c096b57b0f2bd, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=d79837cddc7b4e4dbf0dbe16d50fa0fa) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:18.818156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49e39a-612c-4e1b-8787-518f18586503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:18.820584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49e39a-612c-4e1b-8787-518f18586503 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:18.823529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:18.831243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 489/982] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:18 2022] GET /identity/v3/role_assignments?user.id=d79837cddc7b4e4dbf0dbe16d50fa0fa&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=a132edd9902c4f9dab5c096b57b0f2bd => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:19.126019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a283bf-b863-4c7b-832f-59dbe74f553d None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:19.126368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a283bf-b863-4c7b-832f-59dbe74f553d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:19.126602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a283bf-b863-4c7b-832f-59dbe74f553d None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:19.128098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 494/983] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:19.133600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51e2a0-8c68-46c5-b19d-cd9958399874 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:19.133886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51e2a0-8c68-46c5-b19d-cd9958399874 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:19.134156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51e2a0-8c68-46c5-b19d-cd9958399874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:19.151790 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8d51e2a0-8c68-46c5-b19d-cd9958399874 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:19.152977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8d51e2a0-8c68-46c5-b19d-cd9958399874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:19.223356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 490/984] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:19.246265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a283bf-b863-4c7b-832f-59dbe74f553d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:19.257166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:19.350803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a283bf-b863-4c7b-832f-59dbe74f553d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:19.385320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:19.386068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:19.386440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:19.386829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:19.387507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:19.389003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:19.397595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:19.398892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:19.399958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:19.401766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 495/985] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:19.407597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51e2a0-8c68-46c5-b19d-cd9958399874 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:19.505526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51e2a0-8c68-46c5-b19d-cd9958399874 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:19.533402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:19.540086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:19.546589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:19.546589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:19.546589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:19.546589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:19.546589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:19.546589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:19.550636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 491/986] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:19.555640 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:19.630818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:19.661448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd581a25-f5ac-4f9a-8279-cf306656decd None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:19.697141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:19.697744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:19.698018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:19.698283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:19.698943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:19.699242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:19.700592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:19.705582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 496/987] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:19.711741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:19.808331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268449-5a46-45f0-9bde-b0c515ce715e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:19.840778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8e9b5-f504-42de-bf9a-300dbc2467b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:19.841377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e9b5-f504-42de-bf9a-300dbc2467b1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:19.841649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e9b5-f504-42de-bf9a-300dbc2467b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:19.841913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e9b5-f504-42de-bf9a-300dbc2467b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:19.842632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8e9b5-f504-42de-bf9a-300dbc2467b1 None admin] RBAC: Adding query filter params (interface=admin, service_id=9ac19a97c49d469b9a40963f43ebb2ac, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:19.842932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8e9b5-f504-42de-bf9a-300dbc2467b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:19.844269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8e9b5-f504-42de-bf9a-300dbc2467b1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:19.849307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 492/988] 10.222.0.45 () {56 vars in 1249 bytes} [Wed Aug 10 08:24:19 2022] GET /identity/v3/endpoints?service_id=9ac19a97c49d469b9a40963f43ebb2ac&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:19.855137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:19.962028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0327e-220c-4e95-a0ce-3a9e4416cc69 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:19.997160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ffaa-dc35-47db-9d5c-b8908d852d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:19.997765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ffaa-dc35-47db-9d5c-b8908d852d89 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:19.998044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ffaa-dc35-47db-9d5c-b8908d852d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:19.998310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ffaa-dc35-47db-9d5c-b8908d852d89 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:19.998940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762ffaa-dc35-47db-9d5c-b8908d852d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:20.000290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762ffaa-dc35-47db-9d5c-b8908d852d89 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:20.002030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:20.014599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 497/989] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:24:19 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:24:20.584188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531b45-3b1c-44fb-bca8-79b753429d95 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:20.584568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531b45-3b1c-44fb-bca8-79b753429d95 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:20.584772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531b45-3b1c-44fb-bca8-79b753429d95 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:20.586259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 493/990] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:20.591157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8d96a-5a5b-4fa8-a910-11abe5612a3a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:20.591521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8d96a-5a5b-4fa8-a910-11abe5612a3a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:20.591857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8d96a-5a5b-4fa8-a910-11abe5612a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:20.609574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bcb8d96a-5a5b-4fa8-a910-11abe5612a3a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:20.610778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bcb8d96a-5a5b-4fa8-a910-11abe5612a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:20.683623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 498/991] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:20.705580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1531b45-3b1c-44fb-bca8-79b753429d95 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:20.765024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:20.808086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1531b45-3b1c-44fb-bca8-79b753429d95 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:20.840393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0f5ca-9e52-432b-b6e7-da18329b66c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:20.840943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f5ca-9e52-432b-b6e7-da18329b66c4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:20.841214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f5ca-9e52-432b-b6e7-da18329b66c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:20.841479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f5ca-9e52-432b-b6e7-da18329b66c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:20.842049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0f5ca-9e52-432b-b6e7-da18329b66c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:20.843418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0f5ca-9e52-432b-b6e7-da18329b66c4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f7b0f5ca-9e52-432b-b6e7-da18329b66c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:20.852319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:20.853289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:20.854149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:20.858409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 494/992] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:20.859239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8d96a-5a5b-4fa8-a910-11abe5612a3a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:20.887589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba8abf-83f1-4f11-b7f8-38ce85343c4f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:20.887874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba8abf-83f1-4f11-b7f8-38ce85343c4f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:20.888148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba8abf-83f1-4f11-b7f8-38ce85343c4f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:20.889518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 495/993] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:20.894326 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a995c-d1b7-43c7-9089-dc64054c2355 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:20.894637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a995c-d1b7-43c7-9089-dc64054c2355 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:20.894911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a995c-d1b7-43c7-9089-dc64054c2355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:20.912309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-443a995c-d1b7-43c7-9089-dc64054c2355 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:20.913521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-443a995c-d1b7-43c7-9089-dc64054c2355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:20.968722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8d96a-5a5b-4fa8-a910-11abe5612a3a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:20.998735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 496/994] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:20.999388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:21.005039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:21.005703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:21.005985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:21.006254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:21.007000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:21.007304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:21.008681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:21.010261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a995c-d1b7-43c7-9089-dc64054c2355 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:21.013487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 499/995] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:24:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:21.019042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:21.065829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:21.117733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a995c-d1b7-43c7-9089-dc64054c2355 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:21.127394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c188e9-daf2-4fce-9f42-93f8aae1bb36 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:21.154649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:21.155276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:21.155554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:21.155879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] PATH_INFO: `/v3/services/image` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:21.156445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:21.157789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:21.163224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:21.164370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:21.164645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:21.164914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:21.165538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:21.165840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:21.167210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:21.167320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:21.168228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:21.169086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 497/996] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Aug 10 08:24:21 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:21.174083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 500/997] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:24:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:21.174844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:21.180666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:21.240165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:21.284202 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d05cda-52c8-49cf-838a-f35563682d1c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:21.296664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed301ca-6a07-4ce7-a844-f2ea44976d2f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:21.315526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:21.320625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:21.321487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:21.321761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:21.322113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:21.323266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] RBAC: Adding query filter params (interface=public, service_id=92333a45048d4afb8459d01ac8cffdee, region_id=RegionOne) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:21.330162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:21.330162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:21.331233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 501/998] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 10 08:24:21 2022] GET /identity/v3/endpoints?service_id=92333a45048d4afb8459d01ac8cffdee&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:21.334222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:21.334859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:21.335198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:21.335599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:21.336234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:21.336537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:21.336644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:21.337901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:21.348083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 498/999] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:21.349289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:21.442295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6c8d4-b653-4b79-916d-7284fe46b499 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:21.458415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec7974-0293-4165-846f-71e4c1fe2cf8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:21.464877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:21.478188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c5b7d-cc64-4853-b756-cff71e51777d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:21.478886 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5b7d-cc64-4853-b756-cff71e51777d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:21.479163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5b7d-cc64-4853-b756-cff71e51777d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:21.479439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5b7d-cc64-4853-b756-cff71e51777d None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:21.480045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c5b7d-cc64-4853-b756-cff71e51777d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:21.481631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c5b7d-cc64-4853-b756-cff71e51777d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:21.488708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 502/1000] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:24:21 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:24:21.502252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383badc-d344-4469-934f-1ffe263755f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:21.502931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383badc-d344-4469-934f-1ffe263755f7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:21.503225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383badc-d344-4469-934f-1ffe263755f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:21.503471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383badc-d344-4469-934f-1ffe263755f7 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:21.504125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383badc-d344-4469-934f-1ffe263755f7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:21.504425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383badc-d344-4469-934f-1ffe263755f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:21.505841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383badc-d344-4469-934f-1ffe263755f7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:21.511420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 499/1001] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:22.006861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514ee7-a8b7-4565-9ce2-b381830d084c None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:22.007376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514ee7-a8b7-4565-9ce2-b381830d084c None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:22.007456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514ee7-a8b7-4565-9ce2-b381830d084c None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:22.008830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 503/1002] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:22.013862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a485-1c47-45c5-a028-037a628f2aec None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:22.014257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a485-1c47-45c5-a028-037a628f2aec None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:22.014436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a485-1c47-45c5-a028-037a628f2aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:22.033116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a430a485-1c47-45c5-a028-037a628f2aec None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:22.034300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a430a485-1c47-45c5-a028-037a628f2aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:22.076188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:22.102205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 500/1003] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:22.123938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514ee7-a8b7-4565-9ce2-b381830d084c None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:22.227081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514ee7-a8b7-4565-9ce2-b381830d084c None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:22.261025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:22.261651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:22.261929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:22.262197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:22.262855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:22.264211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:22.272840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:22.274450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 08:24:22.275362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:22.278616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 504/1004] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 10 08:24:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:22.280482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430a485-1c47-45c5-a028-037a628f2aec None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:22.376587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430a485-1c47-45c5-a028-037a628f2aec None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:22.409580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:22.410175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:22.410451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:22.410747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:22.411366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:22.411666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:22.413014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:22.418458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 501/1005] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:22.423813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:22.475955 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:22.525301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01727c-c9e0-4445-a423-8648907bb731 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:22.559490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc72b-5f53-4ec3-ba06-422ccf8a7808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:22.560298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc72b-5f53-4ec3-ba06-422ccf8a7808 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:22.560433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc72b-5f53-4ec3-ba06-422ccf8a7808 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:22.560660 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc72b-5f53-4ec3-ba06-422ccf8a7808 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:22.561299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc72b-5f53-4ec3-ba06-422ccf8a7808 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:22.561604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc72b-5f53-4ec3-ba06-422ccf8a7808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:22.563016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc72b-5f53-4ec3-ba06-422ccf8a7808 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:22.570786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 505/1006] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 10 08:24:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:22.576443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:22.626614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:22.687109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d0d61-aaf4-45b4-b519-39f3bfc9bed5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:22.721045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9477c75-3dc7-4539-bd90-4e8a4b2e7803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:22.721652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477c75-3dc7-4539-bd90-4e8a4b2e7803 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:22.721928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477c75-3dc7-4539-bd90-4e8a4b2e7803 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:22.722198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477c75-3dc7-4539-bd90-4e8a4b2e7803 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:22.722872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9477c75-3dc7-4539-bd90-4e8a4b2e7803 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:22.724223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9477c75-3dc7-4539-bd90-4e8a4b2e7803 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:22.810324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 502/1007] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:24:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:23.509403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868864-22ac-490a-8a51-07ce2ac1e62f None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:23.509926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868864-22ac-490a-8a51-07ce2ac1e62f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:23.509926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868864-22ac-490a-8a51-07ce2ac1e62f None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:23.511332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 506/1008] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:23.513340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eff25-534b-40ba-812a-f874b89c39f7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:23.513774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eff25-534b-40ba-812a-f874b89c39f7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:23.513950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eff25-534b-40ba-812a-f874b89c39f7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:23.515598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 503/1009] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:23.516244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c25c23-2343-40d7-bbc6-13b6844622f6 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:23.516578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c25c23-2343-40d7-bbc6-13b6844622f6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:23.516866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c25c23-2343-40d7-bbc6-13b6844622f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:23.520366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266add9-256a-4a04-bc2e-b63e20898195 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:23.520647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266add9-256a-4a04-bc2e-b63e20898195 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:23.520919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266add9-256a-4a04-bc2e-b63e20898195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:23.535331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-51c25c23-2343-40d7-bbc6-13b6844622f6 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:23.536519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-51c25c23-2343-40d7-bbc6-13b6844622f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:23.541918 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1266add9-256a-4a04-bc2e-b63e20898195 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:23.543217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1266add9-256a-4a04-bc2e-b63e20898195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:23.615242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 507/1010] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:23.626513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 504/1011] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:23.637316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c25c23-2343-40d7-bbc6-13b6844622f6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:23.649396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266add9-256a-4a04-bc2e-b63e20898195 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:23.678796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:23.685164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:23.745520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c25c23-2343-40d7-bbc6-13b6844622f6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:23.752697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266add9-256a-4a04-bc2e-b63e20898195 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:23.784210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf7740-900a-4de9-b3c9-ecc5422b4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:23.784746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7740-900a-4de9-b3c9-ecc5422b4cf1 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:23.785026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7740-900a-4de9-b3c9-ecc5422b4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:23.785297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7740-900a-4de9-b3c9-ecc5422b4cf1 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:23.785936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf7740-900a-4de9-b3c9-ecc5422b4cf1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:23.787339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf7740-900a-4de9-b3c9-ecc5422b4cf1 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:23.790515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:23.791143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:23.791418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:23.791692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:23.792270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:23.793610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:23.802265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:23.806164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:23.808144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 505/1012] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:23.809971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:23.878512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 508/1013] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:24:23 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:23.912708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:23.925230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c2c4-277f-4661-951c-2ca9fae74c1e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:23.981312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:23.982200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:23.982667 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:23.982935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:23.983580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:23.983874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:23.985381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:23.997610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 506/1014] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:24:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:23.998681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf7740-900a-4de9-b3c9-ecc5422b4cf1 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:24.102629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:24.105896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf7740-900a-4de9-b3c9-ecc5422b4cf1 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:24.138700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ca4dd-2ad2-4337-9178-45c80c80ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:24.139298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ca4dd-2ad2-4337-9178-45c80c80ba22 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:24.139573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ca4dd-2ad2-4337-9178-45c80c80ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:24.139832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ca4dd-2ad2-4337-9178-45c80c80ba22 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:24.140524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ca4dd-2ad2-4337-9178-45c80c80ba22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:24.140820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ca4dd-2ad2-4337-9178-45c80c80ba22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:24.142226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ca4dd-2ad2-4337-9178-45c80c80ba22 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:24.151902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 509/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 10 08:24:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:24.154010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:24.255817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c231b0-441b-4fd8-bbcf-75c7a1a36485 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:24.290197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52eb0e-3eed-42ab-8359-a0573900c3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:24.290846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52eb0e-3eed-42ab-8359-a0573900c3bf None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:24.291125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52eb0e-3eed-42ab-8359-a0573900c3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:24.291389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52eb0e-3eed-42ab-8359-a0573900c3bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:24.292038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52eb0e-3eed-42ab-8359-a0573900c3bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:24.293399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52eb0e-3eed-42ab-8359-a0573900c3bf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:24.466217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 507/1016] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:24:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:24.839178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd9195-c3f9-4fbd-be0d-ff8b42c95f06 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:24.839696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd9195-c3f9-4fbd-be0d-ff8b42c95f06 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:24.839696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd9195-c3f9-4fbd-be0d-ff8b42c95f06 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:24.841232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 510/1017] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:24.846416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c281a-1f13-4316-bfa5-50e68e54a607 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:24.846821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c281a-1f13-4316-bfa5-50e68e54a607 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:24.847001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c281a-1f13-4316-bfa5-50e68e54a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:24.868090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a76c281a-1f13-4316-bfa5-50e68e54a607 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:24.869310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a76c281a-1f13-4316-bfa5-50e68e54a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:24.871364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:24.948317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 508/1018] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:24.979591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd9195-c3f9-4fbd-be0d-ff8b42c95f06 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:25.084393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd9195-c3f9-4fbd-be0d-ff8b42c95f06 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:25.118147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dc5c2-cf3f-46f0-a086-b813b8ab7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:25.118722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc5c2-cf3f-46f0-a086-b813b8ab7d70 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:25.119014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc5c2-cf3f-46f0-a086-b813b8ab7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:25.119269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc5c2-cf3f-46f0-a086-b813b8ab7d70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:25.120376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dc5c2-cf3f-46f0-a086-b813b8ab7d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:25.121794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dc5c2-cf3f-46f0-a086-b813b8ab7d70 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:25.126542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 511/1019] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:25.129179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c281a-1f13-4316-bfa5-50e68e54a607 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:25.229367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c281a-1f13-4316-bfa5-50e68e54a607 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:25.263531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17b0f0-0be1-4e96-8fc5-c1ceb03e70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:25.264138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b0f0-0be1-4e96-8fc5-c1ceb03e70f0 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:25.264414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b0f0-0be1-4e96-8fc5-c1ceb03e70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:25.264703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b0f0-0be1-4e96-8fc5-c1ceb03e70f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:25.265342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17b0f0-0be1-4e96-8fc5-c1ceb03e70f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:25.266786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17b0f0-0be1-4e96-8fc5-c1ceb03e70f0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:25.271396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:25.414575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 509/1020] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:24:25 2022] POST /identity/v3/projects => generated 311 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:25.923372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641794d-6569-41a8-aba3-2ff1c668c2a5 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:25.924378 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641794d-6569-41a8-aba3-2ff1c668c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:25.924862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641794d-6569-41a8-aba3-2ff1c668c2a5 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:25.926779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 512/1021] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:25.932246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425261de-ab5c-4435-b7fd-e4cc467f558a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:25.932677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425261de-ab5c-4435-b7fd-e4cc467f558a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:25.932877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425261de-ab5c-4435-b7fd-e4cc467f558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:25.954044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-425261de-ab5c-4435-b7fd-e4cc467f558a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:25.955263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-425261de-ab5c-4435-b7fd-e4cc467f558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:26.030499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 510/1022] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:26.049062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641794d-6569-41a8-aba3-2ff1c668c2a5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:26.081250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:26.152884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641794d-6569-41a8-aba3-2ff1c668c2a5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:26.185712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:26.186259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:26.186560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:26.186832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:26.187412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:26.188766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:26.198297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:26.199327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:26.200151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 513/1023] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Aug 10 08:24:26 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:26.205495 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425261de-ab5c-4435-b7fd-e4cc467f558a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:26.314693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425261de-ab5c-4435-b7fd-e4cc467f558a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:26.332089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:26.349716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:26.350323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:26.350634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:26.350934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:26.351562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:26.351859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:26.353224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:26.362516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 511/1024] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:26.363764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:26.460150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:26.466327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd7f8-3d60-4dcb-839e-0fa182d8ffb3 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:26.500528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dd363-50e9-4e66-a08d-07e6dc8e3796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:26.501128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dd363-50e9-4e66-a08d-07e6dc8e3796 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:26.501406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dd363-50e9-4e66-a08d-07e6dc8e3796 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:26.501675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dd363-50e9-4e66-a08d-07e6dc8e3796 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:26.502301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dd363-50e9-4e66-a08d-07e6dc8e3796 None admin] RBAC: Adding query filter params (type=image) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:26.502630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dd363-50e9-4e66-a08d-07e6dc8e3796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:26.503989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dd363-50e9-4e66-a08d-07e6dc8e3796 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:26.509566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 514/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:26.515207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:26.563370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce55bf6-26cb-4a9e-b484-f8a30d5a2925 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:26.563733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce55bf6-26cb-4a9e-b484-f8a30d5a2925 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:26.563903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce55bf6-26cb-4a9e-b484-f8a30d5a2925 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:26.565518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 515/1026] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:26.571776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a8e8-62ba-4e13-9676-47bc84c2404d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:26.572058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a8e8-62ba-4e13-9676-47bc84c2404d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:26.572327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a8e8-62ba-4e13-9676-47bc84c2404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:26.591513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bdc6a8e8-62ba-4e13-9676-47bc84c2404d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:26.592727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bdc6a8e8-62ba-4e13-9676-47bc84c2404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:26.625032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9404bc1-5388-4ec3-b6f3-ce5f676ba1c5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:26.660156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:26.660757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:26.661031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:26.661295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:26.661989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] RBAC: Adding query filter params (interface=public, service_id=b71d0a2e0a574525be7d6522a0adaae6, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:26.662300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:26.664170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:26.664845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 516/1027] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:26.670267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 512/1028] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 10 08:24:26 2022] GET /identity/v3/endpoints?service_id=b71d0a2e0a574525be7d6522a0adaae6&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:26.675509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6a8e8-62ba-4e13-9676-47bc84c2404d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:26.692087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:26.739700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:26.767856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:26.778494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6a8e8-62ba-4e13-9676-47bc84c2404d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:26.794514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ff82-b2d5-4913-a812-6988e2774dfa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:26.815536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c774ee-ddcc-4ac5-8abf-f32a9c1616d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:26.816549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c774ee-ddcc-4ac5-8abf-f32a9c1616d8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:26.816942 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c774ee-ddcc-4ac5-8abf-f32a9c1616d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:26.817100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c774ee-ddcc-4ac5-8abf-f32a9c1616d8 None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:26.817762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c774ee-ddcc-4ac5-8abf-f32a9c1616d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:26.819413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c774ee-ddcc-4ac5-8abf-f32a9c1616d8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:26.830408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82547b99-88fc-413d-91ec-841dd07fa955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:26.831387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82547b99-88fc-413d-91ec-841dd07fa955 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:26.831843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82547b99-88fc-413d-91ec-841dd07fa955 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:26.832289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82547b99-88fc-413d-91ec-841dd07fa955 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:26.835726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 517/1029] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:24:26 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:24:26.845026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82547b99-88fc-413d-91ec-841dd07fa955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-82547b99-88fc-413d-91ec-841dd07fa955 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:26.850726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:26.852277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:26.853234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:26.860660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 513/1030] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 10 08:24:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:26.862007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c774ee-ddcc-4ac5-8abf-f32a9c1616d8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:26.976764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c774ee-ddcc-4ac5-8abf-f32a9c1616d8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:27.013745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:27.014273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.014599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.014870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.015533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:27.015833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:27.017191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:27.025687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 518/1031] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 10 08:24:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:27.031577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82547b99-88fc-413d-91ec-841dd07fa955 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:27.134296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82547b99-88fc-413d-91ec-841dd07fa955 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:27.136929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:27.169621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:27.170254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.170554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.170828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.180953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:27.182407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:27.199069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:27.201613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:27.202548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:27.202548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:27.202548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:27.202548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 514/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:27.205998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:27.225827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:27.309926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c106d9-9923-4156-aa09-4bc508b62ff0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:27.344507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04b530-dbba-4b89-91f0-5e01f5826f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:27.345112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b530-dbba-4b89-91f0-5e01f5826f47 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.345390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b530-dbba-4b89-91f0-5e01f5826f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.345657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b530-dbba-4b89-91f0-5e01f5826f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.346294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04b530-dbba-4b89-91f0-5e01f5826f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:27.346624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04b530-dbba-4b89-91f0-5e01f5826f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:27.348006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04b530-dbba-4b89-91f0-5e01f5826f47 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:27.360585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 519/1033] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:27.365900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:27.470381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f287f-88c0-4f36-9954-5b66c3151fc5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:27.483031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e784a-7dec-45e4-a09f-7f24ad46efdc None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.483326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e784a-7dec-45e4-a09f-7f24ad46efdc None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.483600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e784a-7dec-45e4-a09f-7f24ad46efdc None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.485111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 520/1034] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:27.489880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d01510-0c2e-43a1-bc82-e26d862fd892 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.490166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d01510-0c2e-43a1-bc82-e26d862fd892 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.490442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d01510-0c2e-43a1-bc82-e26d862fd892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.508162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:27.508782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-11d01510-0c2e-43a1-bc82-e26d862fd892 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:27.508893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.509059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.509329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.509969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-11d01510-0c2e-43a1-bc82-e26d862fd892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:27.517369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:27.518837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:27.532931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:27.534105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:24:27.535273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:27.537162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 515/1035] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:24:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:27.543041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:27.564347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:27.581714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 521/1036] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:27.606342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d01510-0c2e-43a1-bc82-e26d862fd892 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:27.618806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:27.654951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d54c3-40d0-440d-b762-c5909ac35031 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:27.689725 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:27.690373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.690801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.691084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.691822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:27.692130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:27.693563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:27.711243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d01510-0c2e-43a1-bc82-e26d862fd892 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:27.712419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 516/1037] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:24:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:27.717937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:27.748303 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e56091-589b-45d8-841a-551159d11c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:27.748918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e56091-589b-45d8-841a-551159d11c32 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.749196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e56091-589b-45d8-841a-551159d11c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.749468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e56091-589b-45d8-841a-551159d11c32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.750600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e56091-589b-45d8-841a-551159d11c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:27.752275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e56091-589b-45d8-841a-551159d11c32 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:27.758933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 522/1038] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:27.760171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e56091-589b-45d8-841a-551159d11c32 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:27.793687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:27.820356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff0a87-81e8-4ca7-a7d7-0d0d209ee5c3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:27.844739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:27.856747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527a5aa-0778-478a-aaa6-882aeb041dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:27.858580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527a5aa-0778-478a-aaa6-882aeb041dcf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.858580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527a5aa-0778-478a-aaa6-882aeb041dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.858580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527a5aa-0778-478a-aaa6-882aeb041dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.869905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e56091-589b-45d8-841a-551159d11c32 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:27.911902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452da27-379e-4816-9bb5-12f8340e9a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:27.912593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452da27-379e-4816-9bb5-12f8340e9a5c None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:27.912927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452da27-379e-4816-9bb5-12f8340e9a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:27.913251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452da27-379e-4816-9bb5-12f8340e9a5c None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:27.913961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452da27-379e-4816-9bb5-12f8340e9a5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:27.915590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452da27-379e-4816-9bb5-12f8340e9a5c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:27.931126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527a5aa-0778-478a-aaa6-882aeb041dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:27.932699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527a5aa-0778-478a-aaa6-882aeb041dcf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:28.010656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:28.026501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 523/1039] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:24:27 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:24:28.051637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 517/1040] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 08:24:28.058056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452da27-379e-4816-9bb5-12f8340e9a5c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:28.169551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452da27-379e-4816-9bb5-12f8340e9a5c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:28.198715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:28.204263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:28.204938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:28.205213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:28.205475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:28.215748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:28.217176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:28.232427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:28.234198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:28.235180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:28.235180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:28.235180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:28.235180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 524/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:28.240260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527a5aa-0778-478a-aaa6-882aeb041dcf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:28.342719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527a5aa-0778-478a-aaa6-882aeb041dcf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:28.377613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:28.378221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:28.378538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:28.378815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:28.379460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:28.379760 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:28.381139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:28.397225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 518/1042] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:28.399665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:28.501618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da28c3-44b3-434e-b914-589ea51cea71 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:28.534818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:28.535445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:28.535723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:28.535992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:28.543325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:28.544780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:28.557256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:28.558224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:28.559155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 525/1043] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:28.565488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:28.600728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:28.668094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab34f1-bbbd-47d3-a5b6-56cc9691c949 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:28.701107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa668d1-f5e7-4c2f-86c3-be61a9b025e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:28.701710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa668d1-f5e7-4c2f-86c3-be61a9b025e5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:28.701988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa668d1-f5e7-4c2f-86c3-be61a9b025e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:28.702260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa668d1-f5e7-4c2f-86c3-be61a9b025e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:28.702989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa668d1-f5e7-4c2f-86c3-be61a9b025e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:28.703295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa668d1-f5e7-4c2f-86c3-be61a9b025e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:28.704719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa668d1-f5e7-4c2f-86c3-be61a9b025e5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:28.721889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 519/1044] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:28.723086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:28.767213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:28.825178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfe18-5d51-4e89-83fe-37d035ab182c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:28.859328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:28.859921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:28.860026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c420-205a-43a7-a62c-df295c4339ba None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:28.860201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:28.860301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c420-205a-43a7-a62c-df295c4339ba None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:28.860474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:28.860581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c420-205a-43a7-a62c-df295c4339ba None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:28.861196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] RBAC: Adding query filter params (role.id=a132edd9902c4f9dab5c096b57b0f2bd, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=74d6165eeb524d18aa963f3dcaf84dd4) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:28.861508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:28.862001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 520/1045] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:28.862970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:28.866584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a3db8-8980-45f3-8318-aa52cd344748 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:28.866866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a3db8-8980-45f3-8318-aa52cd344748 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:28.867140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a3db8-8980-45f3-8318-aa52cd344748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:28.869220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 526/1046] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:28 2022] GET /identity/v3/role_assignments?user.id=74d6165eeb524d18aa963f3dcaf84dd4&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=a132edd9902c4f9dab5c096b57b0f2bd => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:28.887374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3c1a3db8-8980-45f3-8318-aa52cd344748 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:28.888643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3c1a3db8-8980-45f3-8318-aa52cd344748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:28.968449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 521/1047] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:28.991630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:29.094915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8464d8-7401-461c-ac4a-26c6c2fd0a66 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:29.102213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:29.129068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:29.129694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:29.129968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:29.130234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] PATH_INFO: `/v3/services/image` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:29.130864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:29.132233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:29.141420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:29.142419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:29.143338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 527/1048] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Aug 10 08:24:28 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:29.151716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a3db8-8980-45f3-8318-aa52cd344748 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:29.177557 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:29.255779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a3db8-8980-45f3-8318-aa52cd344748 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:29.289793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:29.290395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:29.290705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:29.290975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:29.291599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:29.291897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:29.293244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:29.302708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 522/1049] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:29.304005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:29.407047 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560280b-6b93-44cc-a7b5-8fc33179d88d None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:29.439776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53050f-784b-45f9-a2cd-2f0dab2baa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:29.440428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53050f-784b-45f9-a2cd-2f0dab2baa1c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:29.440703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53050f-784b-45f9-a2cd-2f0dab2baa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:29.440967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53050f-784b-45f9-a2cd-2f0dab2baa1c None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:29.441585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53050f-784b-45f9-a2cd-2f0dab2baa1c None admin] RBAC: Adding query filter params (type=image) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:29.441880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53050f-784b-45f9-a2cd-2f0dab2baa1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:29.443261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53050f-784b-45f9-a2cd-2f0dab2baa1c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:29.448192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 528/1050] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:29.454116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:29.541913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:29.554272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e479bcc-fa4c-4bca-b808-8ce9000a9ef4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:29.589869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03501b-5cb9-4dce-944a-106d5590dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:29.590880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03501b-5cb9-4dce-944a-106d5590dc08 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:29.591366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03501b-5cb9-4dce-944a-106d5590dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:29.591907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03501b-5cb9-4dce-944a-106d5590dc08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:29.592764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03501b-5cb9-4dce-944a-106d5590dc08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:29.594340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03501b-5cb9-4dce-944a-106d5590dc08 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:29.672374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 523/1051] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:24:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:24:30.106784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523422-7820-4dc2-a411-9cee4bbfdf81 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:30.107315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523422-7820-4dc2-a411-9cee4bbfdf81 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:30.107315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523422-7820-4dc2-a411-9cee4bbfdf81 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:30.108695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 529/1052] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:30.113963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b05a5-ab24-4072-81af-9f6ad7394e1e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:30.114319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b05a5-ab24-4072-81af-9f6ad7394e1e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:30.114686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b05a5-ab24-4072-81af-9f6ad7394e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:30.133516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0b3b05a5-ab24-4072-81af-9f6ad7394e1e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:30.134743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0b3b05a5-ab24-4072-81af-9f6ad7394e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:30.208700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 524/1053] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:30.231749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa523422-7820-4dc2-a411-9cee4bbfdf81 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:30.269119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:30.336078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa523422-7820-4dc2-a411-9cee4bbfdf81 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:30.369624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa183ec0-6a8b-4573-896b-3584b769daa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:30.370360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa183ec0-6a8b-4573-896b-3584b769daa6 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:30.370666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa183ec0-6a8b-4573-896b-3584b769daa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:30.370934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa183ec0-6a8b-4573-896b-3584b769daa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:30.381564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa183ec0-6a8b-4573-896b-3584b769daa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-aa183ec0-6a8b-4573-896b-3584b769daa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:30.386810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:30.387744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:30.388606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:30.393030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 530/1054] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:30.394481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b05a5-ab24-4072-81af-9f6ad7394e1e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:30.467657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:30.498496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b05a5-ab24-4072-81af-9f6ad7394e1e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:30.532845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:30.533447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:30.533723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:30.533990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:30.534676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:30.534977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:30.536369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:30.549007 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 525/1055] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:30.550578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa183ec0-6a8b-4573-896b-3584b769daa6 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:30.646133 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:30.653627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa183ec0-6a8b-4573-896b-3584b769daa6 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:30.687512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d7b5d-0118-465b-bea1-755d3ad11eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:30.688140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7b5d-0118-465b-bea1-755d3ad11eab None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:30.688415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7b5d-0118-465b-bea1-755d3ad11eab None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:30.688683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7b5d-0118-465b-bea1-755d3ad11eab None admin] PATH_INFO: `/v3/users/7c34d9fc290b4384b950ed0a073df16a` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:30.702616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d7b5d-0118-465b-bea1-755d3ad11eab None admin] RBAC: Authorizing `identity:get_user(user_id=7c34d9fc290b4384b950ed0a073df16a)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:30.704101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d7b5d-0118-465b-bea1-755d3ad11eab None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:30.710721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 531/1056] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:30 2022] GET /identity/v3/users/7c34d9fc290b4384b950ed0a073df16a => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:30.712278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:30.821089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbe3e6-1643-4b6d-883a-ac407c0b0615 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:30.850704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:30.855837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf33abd-4743-452c-badc-272062f3c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:30.856611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf33abd-4743-452c-badc-272062f3c80f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:30.856891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf33abd-4743-452c-badc-272062f3c80f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:30.857163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf33abd-4743-452c-badc-272062f3c80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:30.879221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6b7d-1c87-46c1-82e6-7a979aced0cd None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:30.879509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6b7d-1c87-46c1-82e6-7a979aced0cd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:30.879789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6b7d-1c87-46c1-82e6-7a979aced0cd None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:30.881160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 532/1057] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:30.887592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778eee0-f617-46a2-bd3e-3b893ac1da71 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:30.887592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778eee0-f617-46a2-bd3e-3b893ac1da71 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:30.887826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778eee0-f617-46a2-bd3e-3b893ac1da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:30.906040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a778eee0-f617-46a2-bd3e-3b893ac1da71 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:30.907158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a778eee0-f617-46a2-bd3e-3b893ac1da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:30.939609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf33abd-4743-452c-badc-272062f3c80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:30.941831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf33abd-4743-452c-badc-272062f3c80f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:30.981922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 533/1058] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:31.004410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778eee0-f617-46a2-bd3e-3b893ac1da71 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.047335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 526/1059] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:24:31.053012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf33abd-4743-452c-badc-272062f3c80f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.088012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:31.096606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:31.115762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778eee0-f617-46a2-bd3e-3b893ac1da71 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:31.151203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d71aa-e8b5-4fe8-bded-862d7c2de30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:31.151834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d71aa-e8b5-4fe8-bded-862d7c2de30f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.152112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d71aa-e8b5-4fe8-bded-862d7c2de30f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.152383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d71aa-e8b5-4fe8-bded-862d7c2de30f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.160700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf33abd-4743-452c-badc-272062f3c80f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:31.164322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d71aa-e8b5-4fe8-bded-862d7c2de30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-269d71aa-e8b5-4fe8-bded-862d7c2de30f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:31.168962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:31.169916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:31.170815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 534/1060] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:31.176060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d71aa-e8b5-4fe8-bded-862d7c2de30f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.202142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e861-000c-459a-bbbb-62d27c6e9ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:31.202895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e861-000c-459a-bbbb-62d27c6e9ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.203172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e861-000c-459a-bbbb-62d27c6e9ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.203436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e861-000c-459a-bbbb-62d27c6e9ae4 None admin] PATH_INFO: `/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.204617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e861-000c-459a-bbbb-62d27c6e9ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=e78f66b8da834a9fa0b82c9e7a0fcbc1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:31.206061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e861-000c-459a-bbbb-62d27c6e9ae4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:31.207744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 527/1061] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:31.213842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e861-000c-459a-bbbb-62d27c6e9ae4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.288890 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d71aa-e8b5-4fe8-bded-862d7c2de30f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:31.321598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:31.324552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:31.325158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.325261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e861-000c-459a-bbbb-62d27c6e9ae4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:31.325436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.325703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.326366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:31.326709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:31.328431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:31.337252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 535/1062] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:31.342786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.346369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:31.362510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:31.363208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.363378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.363653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.364383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=e78f66b8da834a9fa0b82c9e7a0fcbc1, user.id=7c34d9fc290b4384b950ed0a073df16a) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:31.364690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:31.366111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:31.382500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 528/1063] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/role_assignments?user.id=7c34d9fc290b4384b950ed0a073df16a&scope.project.id=e78f66b8da834a9fa0b82c9e7a0fcbc1&role.id=45149274288845b0a73e18fbb3394202 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:31.462487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa605-98b8-44f3-800e-27648a76376f None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:31.500174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b3ca-abf2-4930-ad63-c684987b9322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:31.500819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b3ca-abf2-4930-ad63-c684987b9322 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.501101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b3ca-abf2-4930-ad63-c684987b9322 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.501371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b3ca-abf2-4930-ad63-c684987b9322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.513309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86b3ca-abf2-4930-ad63-c684987b9322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:31.514835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86b3ca-abf2-4930-ad63-c684987b9322 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-ef86b3ca-abf2-4930-ad63-c684987b9322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:31.530404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:31.531467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:31.532684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:31.532684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:31.532684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:31.532684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 536/1064] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:31.537624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.639476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa993430-d13b-452a-bee3-3771bc7686ec None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:31.673105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd7a6-2cf7-4c5c-834f-c71e5d8c6b5a None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.673426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd7a6-2cf7-4c5c-834f-c71e5d8c6b5a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.673658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbd7a6-2cf7-4c5c-834f-c71e5d8c6b5a None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.674079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b835e-b012-4e78-9588-37929193e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:31.674734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b835e-b012-4e78-9588-37929193e3db None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.675191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b835e-b012-4e78-9588-37929193e3db None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.675306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 537/1065] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:31.675413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b835e-b012-4e78-9588-37929193e3db None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.675921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b835e-b012-4e78-9588-37929193e3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:31.676222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b835e-b012-4e78-9588-37929193e3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:31.677600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b835e-b012-4e78-9588-37929193e3db None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:31.683537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ea126-8923-4e68-b0e7-54abba036a1b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.683892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ea126-8923-4e68-b0e7-54abba036a1b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.684240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ea126-8923-4e68-b0e7-54abba036a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.694947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 529/1066] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:31.696905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b835e-b012-4e78-9588-37929193e3db None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.703071 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-6c5ea126-8923-4e68-b0e7-54abba036a1b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:31.704284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6c5ea126-8923-4e68-b0e7-54abba036a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:31.722982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:31.759713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:31.781673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 538/1067] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:31.803722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ea126-8923-4e68-b0e7-54abba036a1b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.805197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b835e-b012-4e78-9588-37929193e3db None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:31.842928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:31.843559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.843848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.844117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.851911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:31.853395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:31.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:31.869036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:31.870017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 530/1068] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:31.875372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:31.925065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ea126-8923-4e68-b0e7-54abba036a1b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:31.963673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2aea-322f-4a6e-bff6-c3b89017b475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:31.964280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2aea-322f-4a6e-bff6-c3b89017b475 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:31.964558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2aea-322f-4a6e-bff6-c3b89017b475 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:31.964827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2aea-322f-4a6e-bff6-c3b89017b475 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:31.969128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:31.988802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad51de-0751-400b-8916-cc2783667423 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.020186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:32.029744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.030350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.030656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.030926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.031653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:32.031968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.033390 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.035502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2aea-322f-4a6e-bff6-c3b89017b475 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.037093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2aea-322f-4a6e-bff6-c3b89017b475 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.052061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 531/1069] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:32.058130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:32.144624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 539/1070] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 08:24:32.151427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2aea-322f-4a6e-bff6-c3b89017b475 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:32.166992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e7ee2-34a7-490d-91ba-f2b74ed8e359 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.209791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.209791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.209791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.209791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.218377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.219847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.221563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:32.234179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:32.235692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:32.236627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:32.236627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:32.236627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:32.236627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 532/1071] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:32.240808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:32.246011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:32.263093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2aea-322f-4a6e-bff6-c3b89017b475 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.300383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.301264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.301537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.301805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.313101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.314560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:32.330716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:32.331743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:32.332656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:32.332656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:32.332656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:32.332656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 540/1072] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:32.337370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:32.348886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea77a24-446e-4ace-aa57-71a572719ed0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.385727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.386332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.386642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.386912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.387555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:32.387854 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.389203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.404014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 533/1073] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:32.409120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:32.450087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96138c-4f2e-4cd3-92c0-f7f5190a2082 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.471546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:32.487317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.487928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.488205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.490080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.490080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:32.490080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.490873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.498823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:32.503729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 541/1074] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:32.521572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ace5f4-d211-444e-b4ef-ff2ea10b119e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.559695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.560350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.560628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.560897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.568879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.570971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:32.583377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:32.584373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:32.585310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:32.585310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:32.585310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:32.585310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:32.585310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:32.585310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:32.585310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:32.585310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:32.586799 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 534/1075] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:32.590573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:32.695935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f151ca-292b-4214-94a3-0d21e6eb0c79 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.733786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860a9e5-141e-4e38-ad56-47be9c3ad837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.734325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a9e5-141e-4e38-ad56-47be9c3ad837 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.734650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a9e5-141e-4e38-ad56-47be9c3ad837 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.734919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a9e5-141e-4e38-ad56-47be9c3ad837 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.735608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860a9e5-141e-4e38-ad56-47be9c3ad837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:32.735910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860a9e5-141e-4e38-ad56-47be9c3ad837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.737331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860a9e5-141e-4e38-ad56-47be9c3ad837 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.750618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 542/1076] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:32.756428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:32.858845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97c310-29c9-4a11-8c6f-dcac19fb881c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:32.871968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:32.891664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65157-4f62-4b48-8d20-f16bdedbfd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:32.892316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65157-4f62-4b48-8d20-f16bdedbfd79 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:32.892592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65157-4f62-4b48-8d20-f16bdedbfd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:32.892863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65157-4f62-4b48-8d20-f16bdedbfd79 None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/74d6165eeb524d18aa963f3dcaf84dd4/roles/a132edd9902c4f9dab5c096b57b0f2bd` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:32.895023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65157-4f62-4b48-8d20-f16bdedbfd79 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=74d6165eeb524d18aa963f3dcaf84dd4, role_id=a132edd9902c4f9dab5c096b57b0f2bd)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:32.896458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65157-4f62-4b48-8d20-f16bdedbfd79 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:32.978937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 535/1077] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:24:32 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/74d6165eeb524d18aa963f3dcaf84dd4/roles/a132edd9902c4f9dab5c096b57b0f2bd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:33.365138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc644cf5-7f98-4578-b2f8-cf3e14452b60 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:33.365704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc644cf5-7f98-4578-b2f8-cf3e14452b60 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:33.365704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc644cf5-7f98-4578-b2f8-cf3e14452b60 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:33.367078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 543/1078] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:33.372395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00aa49-b93e-44c2-b4a9-6e5feacbb5c9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:33.372826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00aa49-b93e-44c2-b4a9-6e5feacbb5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:33.372938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00aa49-b93e-44c2-b4a9-6e5feacbb5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:33.391863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9c00aa49-b93e-44c2-b4a9-6e5feacbb5c9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:33.393069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9c00aa49-b93e-44c2-b4a9-6e5feacbb5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:33.457668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 536/1079] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:33.479885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc644cf5-7f98-4578-b2f8-cf3e14452b60 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:33.537346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:33.579587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc644cf5-7f98-4578-b2f8-cf3e14452b60 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:33.611503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca74ab-6ee2-47ac-a284-8fb97988a823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:33.612114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca74ab-6ee2-47ac-a284-8fb97988a823 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:33.612388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca74ab-6ee2-47ac-a284-8fb97988a823 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:33.612654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca74ab-6ee2-47ac-a284-8fb97988a823 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:33.623254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca74ab-6ee2-47ac-a284-8fb97988a823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-08ca74ab-6ee2-47ac-a284-8fb97988a823 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:33.627764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:33.628700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:33.629532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 544/1080] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:33.635473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00aa49-b93e-44c2-b4a9-6e5feacbb5c9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:33.730330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00aa49-b93e-44c2-b4a9-6e5feacbb5c9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:33.732584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:33.763655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:33.764248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:33.764522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:33.764787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:33.765439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:33.765735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:33.767121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:33.774859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 537/1081] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:33.780872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca74ab-6ee2-47ac-a284-8fb97988a823 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:33.879008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca74ab-6ee2-47ac-a284-8fb97988a823 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:33.894970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:33.910959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207b94-2717-4b73-b425-1cf275b9c0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:33.911569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207b94-2717-4b73-b425-1cf275b9c0bd None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:33.912050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207b94-2717-4b73-b425-1cf275b9c0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:33.912150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207b94-2717-4b73-b425-1cf275b9c0bd None admin] PATH_INFO: `/v3/users/7c34d9fc290b4384b950ed0a073df16a` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:33.913714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5207b94-2717-4b73-b425-1cf275b9c0bd None admin] RBAC: Authorizing `identity:get_user(user_id=7c34d9fc290b4384b950ed0a073df16a)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:33.915168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5207b94-2717-4b73-b425-1cf275b9c0bd None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:33.916912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 545/1082] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:33 2022] GET /identity/v3/users/7c34d9fc290b4384b950ed0a073df16a => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:33.924701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:34.021971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c204a3b-270f-41ae-a05b-d0219301e6c9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:34.057168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f5e1-3723-4127-b42f-52809aa969a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:34.057803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f5e1-3723-4127-b42f-52809aa969a6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:34.058080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f5e1-3723-4127-b42f-52809aa969a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:34.058351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f5e1-3723-4127-b42f-52809aa969a6 None admin] PATH_INFO: `/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:34.059492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1f5e1-3723-4127-b42f-52809aa969a6 None admin] RBAC: Authorizing `identity:get_project(project_id=e78f66b8da834a9fa0b82c9e7a0fcbc1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:34.060919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1f5e1-3723-4127-b42f-52809aa969a6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:34.062572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 538/1083] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:24:33 2022] GET /identity/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:34.068377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207b94-2717-4b73-b425-1cf275b9c0bd None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:34.166312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207b94-2717-4b73-b425-1cf275b9c0bd None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:34.199532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e178b-86d3-4695-b0e3-f5e4659eba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:34.200174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e178b-86d3-4695-b0e3-f5e4659eba1a None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:34.200452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e178b-86d3-4695-b0e3-f5e4659eba1a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:34.200723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e178b-86d3-4695-b0e3-f5e4659eba1a None admin] PATH_INFO: `/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1/users/7c34d9fc290b4384b950ed0a073df16a/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:34.202690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e178b-86d3-4695-b0e3-f5e4659eba1a None admin] RBAC: Authorizing `identity:create_grant(project_id=e78f66b8da834a9fa0b82c9e7a0fcbc1, user_id=7c34d9fc290b4384b950ed0a073df16a, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:34.204117 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e178b-86d3-4695-b0e3-f5e4659eba1a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:34.298405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 546/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:24:34 2022] PUT /identity/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1/users/7c34d9fc290b4384b950ed0a073df16a/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:34.949748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4dd7-a89e-409f-9b17-d57cf68bd9ae None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:34.950215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4dd7-a89e-409f-9b17-d57cf68bd9ae None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:34.950312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4dd7-a89e-409f-9b17-d57cf68bd9ae None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:34.951674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 539/1085] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:34.957063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b905-cd2e-49bd-b249-665d1a6100e0 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:34.957501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b905-cd2e-49bd-b249-665d1a6100e0 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:34.957603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b905-cd2e-49bd-b249-665d1a6100e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:34.976283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f585b905-cd2e-49bd-b249-665d1a6100e0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:34.977462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f585b905-cd2e-49bd-b249-665d1a6100e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:35.019662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:35.044192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 547/1086] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:35.073623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf4dd7-a89e-409f-9b17-d57cf68bd9ae None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:35.108767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:35.173438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf4dd7-a89e-409f-9b17-d57cf68bd9ae None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:35.207613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127858-aa10-4746-9ddd-f54c9661579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:35.208172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127858-aa10-4746-9ddd-f54c9661579a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:35.208453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127858-aa10-4746-9ddd-f54c9661579a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:35.208727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127858-aa10-4746-9ddd-f54c9661579a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:35.218926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127858-aa10-4746-9ddd-f54c9661579a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d7127858-aa10-4746-9ddd-f54c9661579a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:35.223631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:35.224716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:35.225594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 540/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 10 08:24:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:35.230848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b905-cd2e-49bd-b249-665d1a6100e0 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:35.359968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b905-cd2e-49bd-b249-665d1a6100e0 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:35.395627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:35.396238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:35.396515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:35.396785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:35.397496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:35.397806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:35.399198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:35.407401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 548/1088] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 10 08:24:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:35.413528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127858-aa10-4746-9ddd-f54c9661579a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:35.508083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:35.514740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127858-aa10-4746-9ddd-f54c9661579a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:35.547865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:35.548478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:35.548747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:35.549014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:35.559219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:35.560646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:35.575360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:35.576339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:35.577284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:35.577284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:35.577284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:35.577284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 541/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:35.582243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:35.623010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:35.680889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a345212-0549-4fd0-a2d2-9265f4d5d51a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:35.714195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:35.714810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:35.715084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:35.715347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:35.715975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:35.716266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:35.717608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:35.729720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 549/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:35.735378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:35.832574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae03cb9-b202-44c7-8861-281d5eedc78e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:35.866440 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:35.867105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:35.867379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:35.867649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:35.875257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:35.876700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:24:35.887653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:35.888766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:35.890285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 542/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 10 08:24:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:35.894417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:35.991954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:35.995742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec641af-0a2f-45c9-b79a-09dbd5508bb4 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.029428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27051e7-a2d7-4499-98cf-8f33c992597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.030023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27051e7-a2d7-4499-98cf-8f33c992597b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.030298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27051e7-a2d7-4499-98cf-8f33c992597b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.030599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27051e7-a2d7-4499-98cf-8f33c992597b None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.031326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27051e7-a2d7-4499-98cf-8f33c992597b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:36.031627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27051e7-a2d7-4499-98cf-8f33c992597b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.033066 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27051e7-a2d7-4499-98cf-8f33c992597b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.051153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 550/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 10 08:24:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:36.058140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.067561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.157261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda2b26-18f8-4056-a4be-285ea6a23071 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.188796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75538d0-c2ef-4c53-83c6-9576d47cc557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.189398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75538d0-c2ef-4c53-83c6-9576d47cc557 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.189671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75538d0-c2ef-4c53-83c6-9576d47cc557 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.189938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75538d0-c2ef-4c53-83c6-9576d47cc557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.262600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75538d0-c2ef-4c53-83c6-9576d47cc557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.264073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75538d0-c2ef-4c53-83c6-9576d47cc557 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.271813 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.291738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bee966-7c73-4342-92b4-fe420ff3d58b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.292015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bee966-7c73-4342-92b4-fe420ff3d58b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.292282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bee966-7c73-4342-92b4-fe420ff3d58b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.293742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 551/1093] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:24:36.298907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd51b7-6449-4bf3-863c-38419dbd3266 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.299192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd51b7-6449-4bf3-863c-38419dbd3266 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.299464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd51b7-6449-4bf3-863c-38419dbd3266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.316839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3fbd51b7-6449-4bf3-863c-38419dbd3266 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:36.318817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3fbd51b7-6449-4bf3-863c-38419dbd3266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:36.375119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 543/1094] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:24:36.380792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75538d0-c2ef-4c53-83c6-9576d47cc557 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.385920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 552/1095] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:36.409635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd51b7-6449-4bf3-863c-38419dbd3266 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.476518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75538d0-c2ef-4c53-83c6-9576d47cc557 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.483745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.495156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.509507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd51b7-6449-4bf3-863c-38419dbd3266 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.511036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.512018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.512499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.512970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.524606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.526058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:24:36.542115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:36.543376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:24:36.544292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:24:36.544292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:24:36.544292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:36.544481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1b635-04ee-4c34-9e75-c0a2602af69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.544905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1b635-04ee-4c34-9e75-c0a2602af69a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.545722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1b635-04ee-4c34-9e75-c0a2602af69a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.546019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1b635-04ee-4c34-9e75-c0a2602af69a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.546624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 544/1096] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:36.548862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.557199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1b635-04ee-4c34-9e75-c0a2602af69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-adb1b635-04ee-4c34-9e75-c0a2602af69a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:36.561847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:36.562950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:24:36.563777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 553/1097] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:36.569058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1b635-04ee-4c34-9e75-c0a2602af69a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.648761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae4f74-28d6-43f3-bfe5-ef364152b10c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.670811 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1b635-04ee-4c34-9e75-c0a2602af69a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.682590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.683188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.683459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.683726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.684358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:36.684655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.686006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.697995 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 545/1098] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:36.703493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.708930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.709533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.710318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.710599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.711264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:36.711563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.713338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.722206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.727849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 554/1099] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:36.728915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.739326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.804471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a19543-e23e-40be-9ced-cb410e2997e3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.826898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55dbe4-fff7-4b7a-99b1-3e1863f1f584 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.837988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.838716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.839161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.839588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.848429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.849878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.860356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ad3a-4791-4645-a67b-3e42185e5043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:36.860967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ad3a-4791-4645-a67b-3e42185e5043 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:36.861241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ad3a-4791-4645-a67b-3e42185e5043 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:36.861506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ad3a-4791-4645-a67b-3e42185e5043 None admin] PATH_INFO: `/v3/users/7c34d9fc290b4384b950ed0a073df16a` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:24:36.861852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:36.862741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:36.863663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:24:36.863663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:24:36.863663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:24:36.863663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:24:36.863663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:24:36.863663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:24:36.863663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:24:36.863663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:36.864131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ad3a-4791-4645-a67b-3e42185e5043 None admin] RBAC: Authorizing `identity:get_user(user_id=7c34d9fc290b4384b950ed0a073df16a)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:36.864204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 546/1100] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:24:36.864273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ad3a-4791-4645-a67b-3e42185e5043 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:36.865649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 555/1101] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/users/7c34d9fc290b4384b950ed0a073df16a => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:36.870291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.871287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ad3a-4791-4645-a67b-3e42185e5043 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:36.950310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.954532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:36.971523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43831a6c-0552-4c1f-b42b-250ce6b00e8b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:36.976936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ad3a-4791-4645-a67b-3e42185e5043 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:37.004214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:37.004815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:37.005093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:37.005406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:37.006093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:37.006396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:37.008359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:37.011439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb481d6-515e-4cf4-ad14-bb79c1545075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:37.012785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb481d6-515e-4cf4-ad14-bb79c1545075 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:37.013295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb481d6-515e-4cf4-ad14-bb79c1545075 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:37.013704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb481d6-515e-4cf4-ad14-bb79c1545075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:37.020416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 547/1102] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:37.027022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:37.082716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb481d6-515e-4cf4-ad14-bb79c1545075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:37.084158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb481d6-515e-4cf4-ad14-bb79c1545075 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:37.123606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e007820-1539-4d9f-af82-b581d3d87feb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:37.161252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:37.161859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:37.161993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:37.162134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:37.162410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:37.163195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] RBAC: Adding query filter params (role.id=a132edd9902c4f9dab5c096b57b0f2bd, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=74d6165eeb524d18aa963f3dcaf84dd4) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:37.163499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:37.164912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:37.170636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 548/1103] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:37 2022] GET /identity/v3/role_assignments?user.id=74d6165eeb524d18aa963f3dcaf84dd4&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=a132edd9902c4f9dab5c096b57b0f2bd => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:24:37.185049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 556/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:24:37.191502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:37.196365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:37.305704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06a15-e809-4d25-862f-a1566e6469bf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:37.347814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18c76b-8a58-4aba-b325-bcce8190e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:37.348448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c76b-8a58-4aba-b325-bcce8190e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:37.348723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c76b-8a58-4aba-b325-bcce8190e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:37.348991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c76b-8a58-4aba-b325-bcce8190e9d5 None admin] PATH_INFO: `/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:37.350102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18c76b-8a58-4aba-b325-bcce8190e9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e78f66b8da834a9fa0b82c9e7a0fcbc1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:37.352138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18c76b-8a58-4aba-b325-bcce8190e9d5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:37.353764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 549/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:24:37 2022] GET /identity/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:37.360164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb481d6-515e-4cf4-ad14-bb79c1545075 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:37.460881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb481d6-515e-4cf4-ad14-bb79c1545075 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:37.496783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecfd7e-0d03-4b04-be2f-a3ef1be79570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:37.497386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecfd7e-0d03-4b04-be2f-a3ef1be79570 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:37.497659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecfd7e-0d03-4b04-be2f-a3ef1be79570 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:37.497925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecfd7e-0d03-4b04-be2f-a3ef1be79570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:37.498678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecfd7e-0d03-4b04-be2f-a3ef1be79570 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=e78f66b8da834a9fa0b82c9e7a0fcbc1, user.id=7c34d9fc290b4384b950ed0a073df16a) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:37.498984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecfd7e-0d03-4b04-be2f-a3ef1be79570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:37.500413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecfd7e-0d03-4b04-be2f-a3ef1be79570 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:37.506827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 557/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:37 2022] GET /identity/v3/role_assignments?user.id=7c34d9fc290b4384b950ed0a073df16a&scope.project.id=e78f66b8da834a9fa0b82c9e7a0fcbc1&role.id=45149274288845b0a73e18fbb3394202 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:39.557345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dc314-51db-41ec-bb2e-e30e3d82f97d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:39.557871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dc314-51db-41ec-bb2e-e30e3d82f97d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:39.557871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dc314-51db-41ec-bb2e-e30e3d82f97d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:39.559266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 550/1107] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:39.564400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7714-6cf4-4868-bb0f-978e92c18222 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:39.564772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7714-6cf4-4868-bb0f-978e92c18222 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:39.564943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7714-6cf4-4868-bb0f-978e92c18222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:39.582722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-2d2c7714-6cf4-4868-bb0f-978e92c18222 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:39.583895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2d2c7714-6cf4-4868-bb0f-978e92c18222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:39.617445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:39.648287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 558/1108] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:39.672641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dc314-51db-41ec-bb2e-e30e3d82f97d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:39.740379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:39.769924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dc314-51db-41ec-bb2e-e30e3d82f97d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:39.803165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb16a8-1381-426c-a441-d9e0afd7f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:39.803774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb16a8-1381-426c-a441-d9e0afd7f3fd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:39.804048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb16a8-1381-426c-a441-d9e0afd7f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:39.804312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb16a8-1381-426c-a441-d9e0afd7f3fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:39.805410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb16a8-1381-426c-a441-d9e0afd7f3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:39.806872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb16a8-1381-426c-a441-d9e0afd7f3fd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:39.808455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 551/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:39.814013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7714-6cf4-4868-bb0f-978e92c18222 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:39.908699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7714-6cf4-4868-bb0f-978e92c18222 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:39.942668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e3aa-adb6-4d7f-9b39-c88e00db9a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:39.943515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e3aa-adb6-4d7f-9b39-c88e00db9a5c None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:39.943785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e3aa-adb6-4d7f-9b39-c88e00db9a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:39.944564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e3aa-adb6-4d7f-9b39-c88e00db9a5c None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:39.945195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e3aa-adb6-4d7f-9b39-c88e00db9a5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:39.946648 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e3aa-adb6-4d7f-9b39-c88e00db9a5c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:40.019369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 559/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:24:39 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:42.071003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d05ff-178d-44af-b7d5-f9337777d2fb None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:42.071552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d05ff-178d-44af-b7d5-f9337777d2fb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:42.071552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d05ff-178d-44af-b7d5-f9337777d2fb None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:42.072866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 552/1111] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:42.078143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a78b8-6b95-4a26-9759-257b3aa8e646 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:42.078541 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a78b8-6b95-4a26-9759-257b3aa8e646 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:42.078717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a78b8-6b95-4a26-9759-257b3aa8e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:42.096419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-e11a78b8-6b95-4a26-9759-257b3aa8e646 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:42.097598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e11a78b8-6b95-4a26-9759-257b3aa8e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:42.118054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:42.163294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 560/1112] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:42.186337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d05ff-178d-44af-b7d5-f9337777d2fb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:42.284180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d05ff-178d-44af-b7d5-f9337777d2fb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:42.316898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ed85-2f17-4a84-807f-eef90ff42741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:42.317506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed85-2f17-4a84-807f-eef90ff42741 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:42.317780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed85-2f17-4a84-807f-eef90ff42741 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:42.318046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed85-2f17-4a84-807f-eef90ff42741 None admin] PATH_INFO: `/v3/roles/1cb2ff0f0c514fc19e6847a5c8e3a127` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:42.319703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7ed85-2f17-4a84-807f-eef90ff42741 None admin] RBAC: Authorizing `identity:get_role(role_id=1cb2ff0f0c514fc19e6847a5c8e3a127)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:42.321045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7ed85-2f17-4a84-807f-eef90ff42741 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:42.322322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 553/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:42 2022] GET /identity/v3/roles/1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:42.327953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a78b8-6b95-4a26-9759-257b3aa8e646 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:42.422038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a78b8-6b95-4a26-9759-257b3aa8e646 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:42.455438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72087964-f7d3-4242-90d0-c379b729c5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:42.456045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72087964-f7d3-4242-90d0-c379b729c5ff None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:42.456321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72087964-f7d3-4242-90d0-c379b729c5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:42.456589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72087964-f7d3-4242-90d0-c379b729c5ff None admin] PATH_INFO: `/v3/users/55485b67938e4160b0fff267182d14c0` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:42.469457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72087964-f7d3-4242-90d0-c379b729c5ff None admin] RBAC: Authorizing `identity:get_user(user_id=55485b67938e4160b0fff267182d14c0)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:42.470916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72087964-f7d3-4242-90d0-c379b729c5ff None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:42.472470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 561/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:42 2022] GET /identity/v3/users/55485b67938e4160b0fff267182d14c0 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:42.478940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ed85-2f17-4a84-807f-eef90ff42741 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:42.487542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:42.575028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ed85-2f17-4a84-807f-eef90ff42741 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:42.611080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba71848-1ae9-42c2-ad43-d932e80010e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:42.611672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba71848-1ae9-42c2-ad43-d932e80010e2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:42.611950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba71848-1ae9-42c2-ad43-d932e80010e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:42.612224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba71848-1ae9-42c2-ad43-d932e80010e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:42.676326 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba71848-1ae9-42c2-ad43-d932e80010e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:42.677754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba71848-1ae9-42c2-ad43-d932e80010e2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:42.685155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:42.772797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 554/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:24:42.778673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72087964-f7d3-4242-90d0-c379b729c5ff None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:42.794285 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:42.874413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72087964-f7d3-4242-90d0-c379b729c5ff None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:42.907004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9b80a-b166-466a-b5eb-30eed25ec630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:42.907628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9b80a-b166-466a-b5eb-30eed25ec630 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:42.907900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9b80a-b166-466a-b5eb-30eed25ec630 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:42.908165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9b80a-b166-466a-b5eb-30eed25ec630 None admin] PATH_INFO: `/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:42.909255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9b80a-b166-466a-b5eb-30eed25ec630 None admin] RBAC: Authorizing `identity:get_project(project_id=e78f66b8da834a9fa0b82c9e7a0fcbc1)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:42.910694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9b80a-b166-466a-b5eb-30eed25ec630 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:42.912263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 562/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:24:42 2022] GET /identity/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:42.918080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba71848-1ae9-42c2-ad43-d932e80010e2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:43.014775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba71848-1ae9-42c2-ad43-d932e80010e2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:43.023163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:43.047874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8dbc-6412-42ce-9080-63f5d4949e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:43.048466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8dbc-6412-42ce-9080-63f5d4949e65 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:43.051400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8dbc-6412-42ce-9080-63f5d4949e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:43.051400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8dbc-6412-42ce-9080-63f5d4949e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:43.051400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa8dbc-6412-42ce-9080-63f5d4949e65 None admin] RBAC: Adding query filter params (role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=e78f66b8da834a9fa0b82c9e7a0fcbc1, user.id=55485b67938e4160b0fff267182d14c0) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:43.051400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa8dbc-6412-42ce-9080-63f5d4949e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:43.051400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa8dbc-6412-42ce-9080-63f5d4949e65 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:43.056472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 555/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:42 2022] GET /identity/v3/role_assignments?user.id=55485b67938e4160b0fff267182d14c0&scope.project.id=e78f66b8da834a9fa0b82c9e7a0fcbc1&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:45.004754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642d936-6dd2-4663-be0d-3f1fe330a311 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:45.005252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642d936-6dd2-4663-be0d-3f1fe330a311 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:45.005345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642d936-6dd2-4663-be0d-3f1fe330a311 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:45.007326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 563/1118] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:45.012288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6314ce-bc74-4c5f-957a-d45dbb2511fe None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:45.012692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6314ce-bc74-4c5f-957a-d45dbb2511fe None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:45.012844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6314ce-bc74-4c5f-957a-d45dbb2511fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:45.030598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8b6314ce-bc74-4c5f-957a-d45dbb2511fe None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:45.031777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8b6314ce-bc74-4c5f-957a-d45dbb2511fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:45.095818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 556/1119] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:45.118023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642d936-6dd2-4663-be0d-3f1fe330a311 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:45.196570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:45.214132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642d936-6dd2-4663-be0d-3f1fe330a311 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:45.247407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b74553-51d8-460d-9211-7e6ec90fd600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:45.248013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74553-51d8-460d-9211-7e6ec90fd600 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:45.248285 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74553-51d8-460d-9211-7e6ec90fd600 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:45.248546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74553-51d8-460d-9211-7e6ec90fd600 None admin] PATH_INFO: `/v3/roles/1cb2ff0f0c514fc19e6847a5c8e3a127` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:45.249973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b74553-51d8-460d-9211-7e6ec90fd600 None admin] RBAC: Authorizing `identity:get_role(role_id=1cb2ff0f0c514fc19e6847a5c8e3a127)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:45.251342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b74553-51d8-460d-9211-7e6ec90fd600 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:45.252660 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 564/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:45 2022] GET /identity/v3/roles/1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:45.258427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6314ce-bc74-4c5f-957a-d45dbb2511fe None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:45.349493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:45.352804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6314ce-bc74-4c5f-957a-d45dbb2511fe None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:45.385612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49762a21-59e8-47c0-aaa6-bcbd3f6e2deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:45.386229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762a21-59e8-47c0-aaa6-bcbd3f6e2deb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:45.386528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762a21-59e8-47c0-aaa6-bcbd3f6e2deb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:45.386800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762a21-59e8-47c0-aaa6-bcbd3f6e2deb None admin] PATH_INFO: `/v3/users/55485b67938e4160b0fff267182d14c0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:45.387893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49762a21-59e8-47c0-aaa6-bcbd3f6e2deb None admin] RBAC: Authorizing `identity:get_user(user_id=55485b67938e4160b0fff267182d14c0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:45.389307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49762a21-59e8-47c0-aaa6-bcbd3f6e2deb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:45.390886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 557/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:45 2022] GET /identity/v3/users/55485b67938e4160b0fff267182d14c0 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:45.396577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b74553-51d8-460d-9211-7e6ec90fd600 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:45.491602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b74553-51d8-460d-9211-7e6ec90fd600 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:45.523623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78313989-75ec-4d87-8ed8-d8227ec5bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:45.524218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313989-75ec-4d87-8ed8-d8227ec5bee6 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:45.524490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313989-75ec-4d87-8ed8-d8227ec5bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:45.524755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78313989-75ec-4d87-8ed8-d8227ec5bee6 None admin] PATH_INFO: `/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:45.525848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78313989-75ec-4d87-8ed8-d8227ec5bee6 None admin] RBAC: Authorizing `identity:get_project(project_id=e78f66b8da834a9fa0b82c9e7a0fcbc1)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:45.527276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78313989-75ec-4d87-8ed8-d8227ec5bee6 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:45.528847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 565/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:24:45 2022] GET /identity/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:45.534633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49762a21-59e8-47c0-aaa6-bcbd3f6e2deb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:45.630072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49762a21-59e8-47c0-aaa6-bcbd3f6e2deb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:45.662835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ae6a-4665-4148-9c8b-4114a5db789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:45.663468 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ae6a-4665-4148-9c8b-4114a5db789a None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:45.663749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ae6a-4665-4148-9c8b-4114a5db789a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:45.664023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ae6a-4665-4148-9c8b-4114a5db789a None admin] PATH_INFO: `/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1/users/55485b67938e4160b0fff267182d14c0/roles/1cb2ff0f0c514fc19e6847a5c8e3a127` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:45.666142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4ae6a-4665-4148-9c8b-4114a5db789a None admin] RBAC: Authorizing `identity:create_grant(project_id=e78f66b8da834a9fa0b82c9e7a0fcbc1, user_id=55485b67938e4160b0fff267182d14c0, role_id=1cb2ff0f0c514fc19e6847a5c8e3a127)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:45.667599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4ae6a-4665-4148-9c8b-4114a5db789a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:45.745572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 558/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:24:45 2022] PUT /identity/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1/users/55485b67938e4160b0fff267182d14c0/roles/1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:24:47.688228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468d94-c5a7-4bd1-81d0-7dc4fe5e72a2 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:47.688876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468d94-c5a7-4bd1-81d0-7dc4fe5e72a2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:47.688876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468d94-c5a7-4bd1-81d0-7dc4fe5e72a2 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:47.690083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 566/1124] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:47.695595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e760c6-f187-466b-8ea3-a51f646f80bf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:47.695997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e760c6-f187-466b-8ea3-a51f646f80bf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:47.696135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e760c6-f187-466b-8ea3-a51f646f80bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:47.714016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-80e760c6-f187-466b-8ea3-a51f646f80bf None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:47.715311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-80e760c6-f187-466b-8ea3-a51f646f80bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:47.737534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:47.779917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 559/1125] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:47.801934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468d94-c5a7-4bd1-81d0-7dc4fe5e72a2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:47.821985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:47.900082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468d94-c5a7-4bd1-81d0-7dc4fe5e72a2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:47.932285 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170caca-29a5-4047-a479-2f0b407f8d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:47.932895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170caca-29a5-4047-a479-2f0b407f8d86 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:47.933169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170caca-29a5-4047-a479-2f0b407f8d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:47.933441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170caca-29a5-4047-a479-2f0b407f8d86 None admin] PATH_INFO: `/v3/roles/1cb2ff0f0c514fc19e6847a5c8e3a127` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:47.934848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170caca-29a5-4047-a479-2f0b407f8d86 None admin] RBAC: Authorizing `identity:get_role(role_id=1cb2ff0f0c514fc19e6847a5c8e3a127)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:47.936189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170caca-29a5-4047-a479-2f0b407f8d86 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:47.937487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 567/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:47 2022] GET /identity/v3/roles/1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:47.943652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e760c6-f187-466b-8ea3-a51f646f80bf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:48.039150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e760c6-f187-466b-8ea3-a51f646f80bf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:48.072676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76063c14-3b18-4b66-9a29-17cf5f6f9841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:48.073292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76063c14-3b18-4b66-9a29-17cf5f6f9841 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:48.073569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76063c14-3b18-4b66-9a29-17cf5f6f9841 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:48.073841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76063c14-3b18-4b66-9a29-17cf5f6f9841 None admin] PATH_INFO: `/v3/users/55485b67938e4160b0fff267182d14c0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:48.074978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76063c14-3b18-4b66-9a29-17cf5f6f9841 None admin] RBAC: Authorizing `identity:get_user(user_id=55485b67938e4160b0fff267182d14c0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:48.076399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76063c14-3b18-4b66-9a29-17cf5f6f9841 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:48.077967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 560/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:47 2022] GET /identity/v3/users/55485b67938e4160b0fff267182d14c0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:48.083661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170caca-29a5-4047-a479-2f0b407f8d86 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:48.164692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:48.179243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170caca-29a5-4047-a479-2f0b407f8d86 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:48.211790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625eff4-d4fc-410b-9ea7-ac43b95201a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:48.212322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625eff4-d4fc-410b-9ea7-ac43b95201a8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:48.212599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625eff4-d4fc-410b-9ea7-ac43b95201a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:48.212866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625eff4-d4fc-410b-9ea7-ac43b95201a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:48.277218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625eff4-d4fc-410b-9ea7-ac43b95201a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:48.278664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625eff4-d4fc-410b-9ea7-ac43b95201a8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:48.357213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:48.372232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 568/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:24:48.378016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76063c14-3b18-4b66-9a29-17cf5f6f9841 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:48.404470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:48.474672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76063c14-3b18-4b66-9a29-17cf5f6f9841 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:48.506860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fab7d5-c2e7-4f0f-8be3-2e57c3b10264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:48.507469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab7d5-c2e7-4f0f-8be3-2e57c3b10264 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:48.507743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab7d5-c2e7-4f0f-8be3-2e57c3b10264 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:48.508013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab7d5-c2e7-4f0f-8be3-2e57c3b10264 None admin] PATH_INFO: `/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:48.509113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fab7d5-c2e7-4f0f-8be3-2e57c3b10264 None admin] RBAC: Authorizing `identity:get_project(project_id=e78f66b8da834a9fa0b82c9e7a0fcbc1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:48.510573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fab7d5-c2e7-4f0f-8be3-2e57c3b10264 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:48.512184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 561/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:24:48 2022] GET /identity/v3/projects/e78f66b8da834a9fa0b82c9e7a0fcbc1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:48.518176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625eff4-d4fc-410b-9ea7-ac43b95201a8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:48.614860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625eff4-d4fc-410b-9ea7-ac43b95201a8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:48.647381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bb4c-9d6a-460e-adbe-47262d262180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:48.647959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bb4c-9d6a-460e-adbe-47262d262180 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:48.648232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bb4c-9d6a-460e-adbe-47262d262180 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:48.648496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bb4c-9d6a-460e-adbe-47262d262180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:48.649206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bb4c-9d6a-460e-adbe-47262d262180 None admin] RBAC: Adding query filter params (role.id=1cb2ff0f0c514fc19e6847a5c8e3a127, scope.project.id=e78f66b8da834a9fa0b82c9e7a0fcbc1, user.id=55485b67938e4160b0fff267182d14c0) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:48.649505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bb4c-9d6a-460e-adbe-47262d262180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:48.650948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bb4c-9d6a-460e-adbe-47262d262180 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:48.656469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 569/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:48 2022] GET /identity/v3/role_assignments?user.id=55485b67938e4160b0fff267182d14c0&scope.project.id=e78f66b8da834a9fa0b82c9e7a0fcbc1&role.id=1cb2ff0f0c514fc19e6847a5c8e3a127 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:50.638475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fdfed-155e-4d18-b4b1-108fe3ed6282 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:50.639025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fdfed-155e-4d18-b4b1-108fe3ed6282 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:50.639127 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fdfed-155e-4d18-b4b1-108fe3ed6282 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:50.640395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 562/1131] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:50.645591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b9f0-f9e3-492f-ae7b-799791035130 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:50.646000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b9f0-f9e3-492f-ae7b-799791035130 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:50.646135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b9f0-f9e3-492f-ae7b-799791035130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:50.664106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d055b9f0-f9e3-492f-ae7b-799791035130 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:50.665273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d055b9f0-f9e3-492f-ae7b-799791035130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:50.710015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:50.730211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 570/1132] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:50.752555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fdfed-155e-4d18-b4b1-108fe3ed6282 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:50.843099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:50.850981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fdfed-155e-4d18-b4b1-108fe3ed6282 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:50.883639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658973-7285-454b-aeb9-0f28c0c9b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:50.884248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658973-7285-454b-aeb9-0f28c0c9b530 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:50.884520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658973-7285-454b-aeb9-0f28c0c9b530 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:50.884787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658973-7285-454b-aeb9-0f28c0c9b530 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:50.885876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658973-7285-454b-aeb9-0f28c0c9b530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:50.887310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658973-7285-454b-aeb9-0f28c0c9b530 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:50.888893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 563/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:50.894625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055b9f0-f9e3-492f-ae7b-799791035130 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:50.989731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055b9f0-f9e3-492f-ae7b-799791035130 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:51.021543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2bfa-7130-4842-beaa-02b9f0f79b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:51.022636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2bfa-7130-4842-beaa-02b9f0f79b91 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:51.022915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2bfa-7130-4842-beaa-02b9f0f79b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:51.023184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2bfa-7130-4842-beaa-02b9f0f79b91 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:51.023812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2bfa-7130-4842-beaa-02b9f0f79b91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:51.025221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2bfa-7130-4842-beaa-02b9f0f79b91 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:51.099871 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 571/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:24:50 2022] POST /identity/v3/projects => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:53.101455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd88c6-2a2c-47f1-9728-dd75317fd389 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:53.101989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd88c6-2a2c-47f1-9728-dd75317fd389 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:53.101989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd88c6-2a2c-47f1-9728-dd75317fd389 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:53.103341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 564/1135] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:53.108602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446e257-8d9d-4f7e-9936-e5eb5aafbe38 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:53.109029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446e257-8d9d-4f7e-9936-e5eb5aafbe38 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:53.109131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446e257-8d9d-4f7e-9936-e5eb5aafbe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:53.127038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-2446e257-8d9d-4f7e-9936-e5eb5aafbe38 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:53.128224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2446e257-8d9d-4f7e-9936-e5eb5aafbe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:53.153294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:53.192579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 572/1136] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:53.217276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd88c6-2a2c-47f1-9728-dd75317fd389 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:53.313587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd88c6-2a2c-47f1-9728-dd75317fd389 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:53.345894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5ac7c-93a6-4405-bee6-53a6704e6eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:53.346520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5ac7c-93a6-4405-bee6-53a6704e6eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:53.346794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5ac7c-93a6-4405-bee6-53a6704e6eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:53.347059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5ac7c-93a6-4405-bee6-53a6704e6eb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:53.348148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5ac7c-93a6-4405-bee6-53a6704e6eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:53.349556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5ac7c-93a6-4405-bee6-53a6704e6eb6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:53.351762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 565/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:53.357370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446e257-8d9d-4f7e-9936-e5eb5aafbe38 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:53.451952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446e257-8d9d-4f7e-9936-e5eb5aafbe38 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:53.484915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b08cc5-6d76-4e27-b9ef-4e69850ff330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:53.485441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08cc5-6d76-4e27-b9ef-4e69850ff330 None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:53.485716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08cc5-6d76-4e27-b9ef-4e69850ff330 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:53.485985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08cc5-6d76-4e27-b9ef-4e69850ff330 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:53.486649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b08cc5-6d76-4e27-b9ef-4e69850ff330 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:53.488063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b08cc5-6d76-4e27-b9ef-4e69850ff330 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:53.589740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 573/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:24:53 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:24:55.623328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8860-998d-4a4c-b8e1-894265b9e519 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:55.623854 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8860-998d-4a4c-b8e1-894265b9e519 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:55.623854 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc8860-998d-4a4c-b8e1-894265b9e519 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:55.625203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 566/1139] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:55.630334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beed3eb-730f-4aee-bea3-281fa1e30ca1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:55.630783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beed3eb-730f-4aee-bea3-281fa1e30ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:55.631431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beed3eb-730f-4aee-bea3-281fa1e30ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:55.649318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9beed3eb-730f-4aee-bea3-281fa1e30ca1 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:55.650501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9beed3eb-730f-4aee-bea3-281fa1e30ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:55.663314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:55.719519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 574/1140] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:24:55.742578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc8860-998d-4a4c-b8e1-894265b9e519 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:55.772798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:55.841104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc8860-998d-4a4c-b8e1-894265b9e519 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:55.872910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea2001-4c3b-4e4b-a527-b342723b41a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:55.873565 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea2001-4c3b-4e4b-a527-b342723b41a1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:55.873791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea2001-4c3b-4e4b-a527-b342723b41a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:55.874058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea2001-4c3b-4e4b-a527-b342723b41a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:55.884236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea2001-4c3b-4e4b-a527-b342723b41a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d4ea2001-4c3b-4e4b-a527-b342723b41a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:55.888812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:55.889970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:55.891128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 567/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:55.896006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beed3eb-730f-4aee-bea3-281fa1e30ca1 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:55.994846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beed3eb-730f-4aee-bea3-281fa1e30ca1 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:56.027361 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:56.027951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:56.028225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:56.028493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:56.029153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:56.029451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:56.030829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:56.038514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 575/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:56.044289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea2001-4c3b-4e4b-a527-b342723b41a1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:56.133262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:56.142201 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea2001-4c3b-4e4b-a527-b342723b41a1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:56.176306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a98749-4fea-4375-ba29-6c18da8094b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:56.176917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a98749-4fea-4375-ba29-6c18da8094b4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:56.177190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a98749-4fea-4375-ba29-6c18da8094b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:56.177459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a98749-4fea-4375-ba29-6c18da8094b4 None admin] PATH_INFO: `/v3/users/7cf54561e1ca4ea0b59e623f92fc03ae` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:56.190588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a98749-4fea-4375-ba29-6c18da8094b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf54561e1ca4ea0b59e623f92fc03ae)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:56.192004 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a98749-4fea-4375-ba29-6c18da8094b4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:56.194458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 568/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:56 2022] GET /identity/v3/users/7cf54561e1ca4ea0b59e623f92fc03ae => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:56.200216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:56.212552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:56.296278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1ea18-0a72-4610-afa6-2ff0fc004206 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:56.329285 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664987fd-7650-460e-a149-d954622cbe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:56.329874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664987fd-7650-460e-a149-d954622cbe29 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:56.330152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664987fd-7650-460e-a149-d954622cbe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:56.330421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664987fd-7650-460e-a149-d954622cbe29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:56.396028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664987fd-7650-460e-a149-d954622cbe29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:56.397421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664987fd-7650-460e-a149-d954622cbe29 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:56.448502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:56.531676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 576/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:24:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:24:56.538018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a98749-4fea-4375-ba29-6c18da8094b4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:56.634672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a98749-4fea-4375-ba29-6c18da8094b4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:56.666867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32848b-111d-4c48-8162-b70403dfb6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:56.667420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32848b-111d-4c48-8162-b70403dfb6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:56.667689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32848b-111d-4c48-8162-b70403dfb6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:56.667955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32848b-111d-4c48-8162-b70403dfb6a5 None admin] PATH_INFO: `/v3/projects/b8019d37d36c45cabbc0e31bec1ddfd4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:56.669049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32848b-111d-4c48-8162-b70403dfb6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=b8019d37d36c45cabbc0e31bec1ddfd4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:56.670498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32848b-111d-4c48-8162-b70403dfb6a5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:56.672392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 569/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:24:56 2022] GET /identity/v3/projects/b8019d37d36c45cabbc0e31bec1ddfd4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:56.678721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664987fd-7650-460e-a149-d954622cbe29 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:56.775057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664987fd-7650-460e-a149-d954622cbe29 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:56.785214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:56.807794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19076477-5fd4-45b7-a77e-1ecfc5319766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:56.817888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19076477-5fd4-45b7-a77e-1ecfc5319766 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:56.817888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19076477-5fd4-45b7-a77e-1ecfc5319766 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:56.817888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19076477-5fd4-45b7-a77e-1ecfc5319766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:56.817888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19076477-5fd4-45b7-a77e-1ecfc5319766 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=b8019d37d36c45cabbc0e31bec1ddfd4, user.id=7cf54561e1ca4ea0b59e623f92fc03ae) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:56.817888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19076477-5fd4-45b7-a77e-1ecfc5319766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:56.817888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19076477-5fd4-45b7-a77e-1ecfc5319766 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:56.818365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 577/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:24:56 2022] GET /identity/v3/role_assignments?user.id=7cf54561e1ca4ea0b59e623f92fc03ae&scope.project.id=b8019d37d36c45cabbc0e31bec1ddfd4&role.id=45149274288845b0a73e18fbb3394202 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:58.741368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ece9-add1-4dd3-bb05-ea112eff2c21 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:58.741902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ece9-add1-4dd3-bb05-ea112eff2c21 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:58.741902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ece9-add1-4dd3-bb05-ea112eff2c21 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:58.743272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 570/1147] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:24:58.748248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42a72-3b01-4198-8009-97e06f2cd7f9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:58.748697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42a72-3b01-4198-8009-97e06f2cd7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:58.748803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42a72-3b01-4198-8009-97e06f2cd7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:58.767616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4cb42a72-3b01-4198-8009-97e06f2cd7f9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:24:58.768786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4cb42a72-3b01-4198-8009-97e06f2cd7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:24:58.832515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 578/1148] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:24:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:24:58.854375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377ece9-add1-4dd3-bb05-ea112eff2c21 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:58.871783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:58.953032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377ece9-add1-4dd3-bb05-ea112eff2c21 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:58.985927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786643df-8e5b-491e-a29e-453d00d25788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:58.986564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786643df-8e5b-491e-a29e-453d00d25788 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:58.986843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786643df-8e5b-491e-a29e-453d00d25788 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:58.987115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786643df-8e5b-491e-a29e-453d00d25788 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:58.997354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786643df-8e5b-491e-a29e-453d00d25788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-786643df-8e5b-491e-a29e-453d00d25788 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:24:59.001877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:24:59.003046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:24:59.003953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 571/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:24:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:24:59.009546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb42a72-3b01-4198-8009-97e06f2cd7f9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:59.103793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb42a72-3b01-4198-8009-97e06f2cd7f9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:59.106013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:59.136769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:59.137390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:59.137675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:59.138149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:59.138996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:24:59.139589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:59.140947 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:59.148656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 579/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:59.154442 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786643df-8e5b-491e-a29e-453d00d25788 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:59.228294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:24:59.250330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786643df-8e5b-491e-a29e-453d00d25788 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:59.283115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71764bfc-bfe8-4e26-89f6-22458252aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:59.283722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764bfc-bfe8-4e26-89f6-22458252aceb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:59.283994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764bfc-bfe8-4e26-89f6-22458252aceb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:59.284259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764bfc-bfe8-4e26-89f6-22458252aceb None admin] PATH_INFO: `/v3/users/7cf54561e1ca4ea0b59e623f92fc03ae` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:59.285354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71764bfc-bfe8-4e26-89f6-22458252aceb None admin] RBAC: Authorizing `identity:get_user(user_id=7cf54561e1ca4ea0b59e623f92fc03ae)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:59.286793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71764bfc-bfe8-4e26-89f6-22458252aceb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:59.288363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 572/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:24:59 2022] GET /identity/v3/users/7cf54561e1ca4ea0b59e623f92fc03ae => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:59.294188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:59.389668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9215494-1cd3-469a-9a25-6ebabe1bb6e8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:59.421184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a1c37-2c71-4567-b087-e8b20dbb363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:59.421782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a1c37-2c71-4567-b087-e8b20dbb363a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:59.422053 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a1c37-2c71-4567-b087-e8b20dbb363a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:59.422315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a1c37-2c71-4567-b087-e8b20dbb363a None admin] PATH_INFO: `/v3/projects/b8019d37d36c45cabbc0e31bec1ddfd4` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:59.423433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a1c37-2c71-4567-b087-e8b20dbb363a None admin] RBAC: Authorizing `identity:get_project(project_id=b8019d37d36c45cabbc0e31bec1ddfd4)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:59.424826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a1c37-2c71-4567-b087-e8b20dbb363a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:59.426389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 580/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:24:59 2022] GET /identity/v3/projects/b8019d37d36c45cabbc0e31bec1ddfd4 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:24:59.432686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71764bfc-bfe8-4e26-89f6-22458252aceb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:24:59.527573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71764bfc-bfe8-4e26-89f6-22458252aceb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:24:59.559900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65f55a-40ea-47c8-88ae-a6a5d6850a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:24:59.560520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f55a-40ea-47c8-88ae-a6a5d6850a4b None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:24:59.560792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f55a-40ea-47c8-88ae-a6a5d6850a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:24:59.561058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f55a-40ea-47c8-88ae-a6a5d6850a4b None admin] PATH_INFO: `/v3/projects/b8019d37d36c45cabbc0e31bec1ddfd4/users/7cf54561e1ca4ea0b59e623f92fc03ae/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:24:59.562933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65f55a-40ea-47c8-88ae-a6a5d6850a4b None admin] RBAC: Authorizing `identity:create_grant(project_id=b8019d37d36c45cabbc0e31bec1ddfd4, user_id=7cf54561e1ca4ea0b59e623f92fc03ae, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:24:59.564336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65f55a-40ea-47c8-88ae-a6a5d6850a4b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:24:59.629591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 573/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:24:59 2022] PUT /identity/v3/projects/b8019d37d36c45cabbc0e31bec1ddfd4/users/7cf54561e1ca4ea0b59e623f92fc03ae/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:25:01.584347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7f07e-9422-4a75-9673-2d9571315006 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:01.584876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7f07e-9422-4a75-9673-2d9571315006 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:01.584876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7f07e-9422-4a75-9673-2d9571315006 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:01.586229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 581/1154] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:25:01.591351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82be1-286d-43ac-8100-23a6eefe9e25 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:01.591751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82be1-286d-43ac-8100-23a6eefe9e25 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:01.591887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82be1-286d-43ac-8100-23a6eefe9e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:01.599001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:01.609978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-44b82be1-286d-43ac-8100-23a6eefe9e25 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:25:01.616010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-44b82be1-286d-43ac-8100-23a6eefe9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:25:01.676106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 574/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:25:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:25:01.699336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7f07e-9422-4a75-9673-2d9571315006 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:01.733676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:01.797800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7f07e-9422-4a75-9673-2d9571315006 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:01.830322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2070a2-6283-413c-8572-f0b6239e056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:01.830954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070a2-6283-413c-8572-f0b6239e056e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:01.831229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070a2-6283-413c-8572-f0b6239e056e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:01.831497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070a2-6283-413c-8572-f0b6239e056e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:01.842242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2070a2-6283-413c-8572-f0b6239e056e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-1a2070a2-6283-413c-8572-f0b6239e056e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:25:01.846830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:25:01.847900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:25:01.849078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 582/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:25:01.853658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82be1-286d-43ac-8100-23a6eefe9e25 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:01.948167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82be1-286d-43ac-8100-23a6eefe9e25 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:01.981357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:01.981948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:01.982224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:01.982515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:01.983174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:25:01.983471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:01.984825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:01.986127 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:01.993549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 575/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:01.999348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2070a2-6283-413c-8572-f0b6239e056e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:02.088905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:02.095317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2070a2-6283-413c-8572-f0b6239e056e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:02.127334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9751e15-f236-4d83-a5c8-00840caafe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:02.127930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9751e15-f236-4d83-a5c8-00840caafe10 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:02.128204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9751e15-f236-4d83-a5c8-00840caafe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:02.128470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9751e15-f236-4d83-a5c8-00840caafe10 None admin] PATH_INFO: `/v3/users/7cf54561e1ca4ea0b59e623f92fc03ae` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:02.129562 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9751e15-f236-4d83-a5c8-00840caafe10 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf54561e1ca4ea0b59e623f92fc03ae)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:02.131587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9751e15-f236-4d83-a5c8-00840caafe10 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:02.133113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 583/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:25:01 2022] GET /identity/v3/users/7cf54561e1ca4ea0b59e623f92fc03ae => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:25:02.138660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:02.233432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562b88-5461-4152-a34b-a41caaedf739 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:02.265985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83b64b-5aef-493b-8f0f-17a656f002d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:02.266598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b64b-5aef-493b-8f0f-17a656f002d5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:02.266875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b64b-5aef-493b-8f0f-17a656f002d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:02.267147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83b64b-5aef-493b-8f0f-17a656f002d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:02.325314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:02.331516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83b64b-5aef-493b-8f0f-17a656f002d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:02.339536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83b64b-5aef-493b-8f0f-17a656f002d5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:02.426871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 576/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:25:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:25:02.433407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9751e15-f236-4d83-a5c8-00840caafe10 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:02.528790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9751e15-f236-4d83-a5c8-00840caafe10 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:02.561326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00eb95c-9906-4dac-a012-9511d7591e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:02.561921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb95c-9906-4dac-a012-9511d7591e79 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:02.562192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb95c-9906-4dac-a012-9511d7591e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:02.562456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eb95c-9906-4dac-a012-9511d7591e79 None admin] PATH_INFO: `/v3/projects/b8019d37d36c45cabbc0e31bec1ddfd4` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:02.563568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eb95c-9906-4dac-a012-9511d7591e79 None admin] RBAC: Authorizing `identity:get_project(project_id=b8019d37d36c45cabbc0e31bec1ddfd4)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:02.564965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00eb95c-9906-4dac-a012-9511d7591e79 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:02.566550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 584/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:25:02 2022] GET /identity/v3/projects/b8019d37d36c45cabbc0e31bec1ddfd4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:02.572629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83b64b-5aef-493b-8f0f-17a656f002d5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:02.660599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:02.666633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83b64b-5aef-493b-8f0f-17a656f002d5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:02.699848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843880b5-ef6d-4ced-ac0d-5093e179ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:02.700368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843880b5-ef6d-4ced-ac0d-5093e179ec33 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:02.700642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843880b5-ef6d-4ced-ac0d-5093e179ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:02.700911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843880b5-ef6d-4ced-ac0d-5093e179ec33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:02.701628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843880b5-ef6d-4ced-ac0d-5093e179ec33 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=b8019d37d36c45cabbc0e31bec1ddfd4, user.id=7cf54561e1ca4ea0b59e623f92fc03ae) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:25:02.701931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843880b5-ef6d-4ced-ac0d-5093e179ec33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:02.703370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843880b5-ef6d-4ced-ac0d-5093e179ec33 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:02.709381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 577/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:25:02 2022] GET /identity/v3/role_assignments?user.id=7cf54561e1ca4ea0b59e623f92fc03ae&scope.project.id=b8019d37d36c45cabbc0e31bec1ddfd4&role.id=45149274288845b0a73e18fbb3394202 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:04.694864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8f45d-2701-4bf2-aa6e-ba514fd0b886 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:04.695389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8f45d-2701-4bf2-aa6e-ba514fd0b886 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:04.695389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8f45d-2701-4bf2-aa6e-ba514fd0b886 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:04.696724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 585/1162] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:25:04.701883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec904-5089-45a8-82e7-954ca8428347 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:04.702302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec904-5089-45a8-82e7-954ca8428347 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:04.702426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec904-5089-45a8-82e7-954ca8428347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:04.720780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-800ec904-5089-45a8-82e7-954ca8428347 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:25:04.721959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-800ec904-5089-45a8-82e7-954ca8428347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:25:04.786019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 578/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:25:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:25:04.807569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8f45d-2701-4bf2-aa6e-ba514fd0b886 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:04.838315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:04.905990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8f45d-2701-4bf2-aa6e-ba514fd0b886 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:04.938146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92534f-584f-4c2c-a39b-9032dfd500ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:04.938782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92534f-584f-4c2c-a39b-9032dfd500ee None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:04.939058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92534f-584f-4c2c-a39b-9032dfd500ee None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:04.939325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92534f-584f-4c2c-a39b-9032dfd500ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:05.004488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92534f-584f-4c2c-a39b-9032dfd500ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:05.006440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92534f-584f-4c2c-a39b-9032dfd500ee None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:05.033377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:05.100706 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 586/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:25:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:25:05.106713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ec904-5089-45a8-82e7-954ca8428347 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:05.191526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:05.201545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ec904-5089-45a8-82e7-954ca8428347 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:05.233934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e77c1a-20c2-483d-b14d-00886fd2798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:05.234571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c1a-20c2-483d-b14d-00886fd2798c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:05.234851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c1a-20c2-483d-b14d-00886fd2798c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:05.235123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e77c1a-20c2-483d-b14d-00886fd2798c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:05.242069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77c1a-20c2-483d-b14d-00886fd2798c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:05.243624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e77c1a-20c2-483d-b14d-00886fd2798c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f5e77c1a-20c2-483d-b14d-00886fd2798c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:25:05.255353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:25:05.256978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:25:05.257994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 579/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:25:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:25:05.262907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92534f-584f-4c2c-a39b-9032dfd500ee None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:05.357671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92534f-584f-4c2c-a39b-9032dfd500ee None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:05.385751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:05.391422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb33091-74cc-428c-a733-c0c5d27b0346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:05.392017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33091-74cc-428c-a733-c0c5d27b0346 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:05.392292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33091-74cc-428c-a733-c0c5d27b0346 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:05.392560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33091-74cc-428c-a733-c0c5d27b0346 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:05.393198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb33091-74cc-428c-a733-c0c5d27b0346 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:25:05.393496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb33091-74cc-428c-a733-c0c5d27b0346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:05.394877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb33091-74cc-428c-a733-c0c5d27b0346 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:05.401800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 587/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 10 08:25:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:07.358865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1bf4-b648-418a-9e5a-e4dcd5c7ac9b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:07.359416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1bf4-b648-418a-9e5a-e4dcd5c7ac9b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:07.359416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1bf4-b648-418a-9e5a-e4dcd5c7ac9b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:07.360659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 580/1167] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:25:07.366298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9fec7-24fe-41e1-a7f6-a6bab86b69b9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:07.366767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9fec7-24fe-41e1-a7f6-a6bab86b69b9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:07.366860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9fec7-24fe-41e1-a7f6-a6bab86b69b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:07.385056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-5be9fec7-24fe-41e1-a7f6-a6bab86b69b9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:25:07.386243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5be9fec7-24fe-41e1-a7f6-a6bab86b69b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:25:07.451136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 588/1168] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:25:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:25:07.473190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1bf4-b648-418a-9e5a-e4dcd5c7ac9b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:07.570264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1bf4-b648-418a-9e5a-e4dcd5c7ac9b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:07.602872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bd6d4-73ac-4cf7-9537-872c375ad69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:07.603455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd6d4-73ac-4cf7-9537-872c375ad69e None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:07.603730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd6d4-73ac-4cf7-9537-872c375ad69e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:07.603994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bd6d4-73ac-4cf7-9537-872c375ad69e None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:07.604644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bd6d4-73ac-4cf7-9537-872c375ad69e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:07.605980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bd6d4-73ac-4cf7-9537-872c375ad69e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:07.676207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 581/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Wed Aug 10 08:25:07 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:25:09.692121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f7db-f9da-467d-a0fa-af01688e8f0e None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:09.692938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f7db-f9da-467d-a0fa-af01688e8f0e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:09.692938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f7db-f9da-467d-a0fa-af01688e8f0e None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:09.694299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 589/1170] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:25:09.699454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44434d6b-5ecd-4ce9-bda3-9fdd5e963abd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:09.699865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44434d6b-5ecd-4ce9-bda3-9fdd5e963abd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:09.700002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44434d6b-5ecd-4ce9-bda3-9fdd5e963abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:09.717995 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-44434d6b-5ecd-4ce9-bda3-9fdd5e963abd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:25:09.719214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-44434d6b-5ecd-4ce9-bda3-9fdd5e963abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:25:09.721932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:09.783068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 582/1171] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:25:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:25:09.806305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f7db-f9da-467d-a0fa-af01688e8f0e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:09.903245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f7db-f9da-467d-a0fa-af01688e8f0e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:09.928258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:09.938352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e507777-1283-4efc-bc83-96b606010252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:09.943273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507777-1283-4efc-bc83-96b606010252 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:09.943273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507777-1283-4efc-bc83-96b606010252 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:09.943273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507777-1283-4efc-bc83-96b606010252 None admin] PATH_INFO: `/v3/domains/f4e068f2755a46c7bb4b08166844f468` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:09.949929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507777-1283-4efc-bc83-96b606010252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f4e068f2755a46c7bb4b08166844f468)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:09.951382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507777-1283-4efc-bc83-96b606010252 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:09.952957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 590/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Aug 10 08:25:09 2022] GET /identity/v3/domains/f4e068f2755a46c7bb4b08166844f468 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:09.958865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44434d6b-5ecd-4ce9-bda3-9fdd5e963abd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:10.054865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44434d6b-5ecd-4ce9-bda3-9fdd5e963abd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:10.087516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a3026-28ce-4c9c-b191-649ca5e00e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:10.088105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a3026-28ce-4c9c-b191-649ca5e00e8a None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:10.088380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a3026-28ce-4c9c-b191-649ca5e00e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:10.088647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a3026-28ce-4c9c-b191-649ca5e00e8a None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:10.089274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a3026-28ce-4c9c-b191-649ca5e00e8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:10.090719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a3026-28ce-4c9c-b191-649ca5e00e8a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:10.101789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:10.173367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 583/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:25:09 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:25:12.193531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c163f-d3f5-43a3-adb5-0a285f81fe79 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:12.194057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c163f-d3f5-43a3-adb5-0a285f81fe79 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:12.194057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c163f-d3f5-43a3-adb5-0a285f81fe79 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:12.195354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 591/1174] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:25:12.200627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d8156-ceca-4292-8a05-ea1ecfb009dc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:12.201003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d8156-ceca-4292-8a05-ea1ecfb009dc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:12.201169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d8156-ceca-4292-8a05-ea1ecfb009dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:12.218556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-875d8156-ceca-4292-8a05-ea1ecfb009dc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:25:12.219721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-875d8156-ceca-4292-8a05-ea1ecfb009dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:25:12.283381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 584/1175] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:25:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:25:12.308233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c163f-d3f5-43a3-adb5-0a285f81fe79 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:12.406622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c163f-d3f5-43a3-adb5-0a285f81fe79 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:12.439669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2691c-3330-46d6-9458-d0dcbd7f0cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:12.440277 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2691c-3330-46d6-9458-d0dcbd7f0cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:12.440549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2691c-3330-46d6-9458-d0dcbd7f0cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:12.440810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2691c-3330-46d6-9458-d0dcbd7f0cd5 None admin] PATH_INFO: `/v3/domains/f4e068f2755a46c7bb4b08166844f468` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:12.441897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2691c-3330-46d6-9458-d0dcbd7f0cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f4e068f2755a46c7bb4b08166844f468)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:12.443681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2691c-3330-46d6-9458-d0dcbd7f0cd5 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:12.445163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 592/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Aug 10 08:25:12 2022] GET /identity/v3/domains/f4e068f2755a46c7bb4b08166844f468 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:12.451001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d8156-ceca-4292-8a05-ea1ecfb009dc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:12.545889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d8156-ceca-4292-8a05-ea1ecfb009dc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:12.567676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:12.578553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc632da2-c580-4e31-9d8f-138449747017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:12.579144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc632da2-c580-4e31-9d8f-138449747017 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:12.579420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc632da2-c580-4e31-9d8f-138449747017 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:12.579686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc632da2-c580-4e31-9d8f-138449747017 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:12.586654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc632da2-c580-4e31-9d8f-138449747017 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:12.586654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc632da2-c580-4e31-9d8f-138449747017 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:12.662669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 585/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:25:12 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:25:14.676702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35f4f0-b7e8-455a-bc3e-5d7a1406dbe5 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:14.677865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35f4f0-b7e8-455a-bc3e-5d7a1406dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:14.677865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35f4f0-b7e8-455a-bc3e-5d7a1406dbe5 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:14.679171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 593/1178] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:25:14.684139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b83d4-de8e-41cb-9f8f-d1b93c4c62fd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:14.684560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b83d4-de8e-41cb-9f8f-d1b93c4c62fd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:14.684685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b83d4-de8e-41cb-9f8f-d1b93c4c62fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:14.703280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b43b83d4-de8e-41cb-9f8f-d1b93c4c62fd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:25:14.704456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b43b83d4-de8e-41cb-9f8f-d1b93c4c62fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:25:14.770060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 586/1179] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:25:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:25:14.793364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35f4f0-b7e8-455a-bc3e-5d7a1406dbe5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:14.845274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:14.890838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35f4f0-b7e8-455a-bc3e-5d7a1406dbe5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:14.928773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aa712-ca76-42f9-8922-b105d4c2f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:14.929321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa712-ca76-42f9-8922-b105d4c2f34e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:14.929595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa712-ca76-42f9-8922-b105d4c2f34e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:14.929859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa712-ca76-42f9-8922-b105d4c2f34e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:14.940077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8aa712-ca76-42f9-8922-b105d4c2f34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-ee8aa712-ca76-42f9-8922-b105d4c2f34e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:25:14.944949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:25:14.946062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:25:14.947337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 594/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:25:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:25:14.952017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b83d4-de8e-41cb-9f8f-d1b93c4c62fd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:15.048112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b83d4-de8e-41cb-9f8f-d1b93c4c62fd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:15.057061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:15.080820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:15.081409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:15.081686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:15.081957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:15.082642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:25:15.082943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:15.084814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:15.093057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 587/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:25:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:15.098303 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aa712-ca76-42f9-8922-b105d4c2f34e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:15.195203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aa712-ca76-42f9-8922-b105d4c2f34e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:15.207296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:15.228069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d9003-c3f0-41b2-8054-0e07b09b6635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:15.228679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9003-c3f0-41b2-8054-0e07b09b6635 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:15.228958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9003-c3f0-41b2-8054-0e07b09b6635 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:15.229229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9003-c3f0-41b2-8054-0e07b09b6635 None admin] PATH_INFO: `/v3/users/5c6d1fefc8fe49269c39123e269420bc` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:15.242619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d9003-c3f0-41b2-8054-0e07b09b6635 None admin] RBAC: Authorizing `identity:get_user(user_id=5c6d1fefc8fe49269c39123e269420bc)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:15.244049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d9003-c3f0-41b2-8054-0e07b09b6635 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:15.245627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 595/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:25:15 2022] GET /identity/v3/users/5c6d1fefc8fe49269c39123e269420bc => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:15.251220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:15.346675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a13e4-067a-4525-a52d-5e6b354d6964 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:15.377717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fcd12-3438-4177-8eb0-c6372e6597b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:15.378300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fcd12-3438-4177-8eb0-c6372e6597b7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:15.378599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fcd12-3438-4177-8eb0-c6372e6597b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:15.378868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fcd12-3438-4177-8eb0-c6372e6597b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:15.416179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:15.443451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fcd12-3438-4177-8eb0-c6372e6597b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:15.444879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fcd12-3438-4177-8eb0-c6372e6597b7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:15.539093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 588/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:25:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:25:15.545031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d9003-c3f0-41b2-8054-0e07b09b6635 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:15.641860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d9003-c3f0-41b2-8054-0e07b09b6635 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:15.673956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016c5be-32e5-4334-b892-3103c70f6868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:15.674586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c5be-32e5-4334-b892-3103c70f6868 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:15.674866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c5be-32e5-4334-b892-3103c70f6868 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:15.675137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c5be-32e5-4334-b892-3103c70f6868 None admin] PATH_INFO: `/v3/projects/921658b1fa4940b68e10bf50c55717b8` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:15.676250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c5be-32e5-4334-b892-3103c70f6868 None admin] RBAC: Authorizing `identity:get_project(project_id=921658b1fa4940b68e10bf50c55717b8)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:15.678183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016c5be-32e5-4334-b892-3103c70f6868 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:15.679818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 596/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:25:15 2022] GET /identity/v3/projects/921658b1fa4940b68e10bf50c55717b8 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:15.685603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fcd12-3438-4177-8eb0-c6372e6597b7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:15.751082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:15.780377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fcd12-3438-4177-8eb0-c6372e6597b7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:15.812690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a85e8-a993-41af-bcfc-76008b502ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:15.813222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a85e8-a993-41af-bcfc-76008b502ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:15.813497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a85e8-a993-41af-bcfc-76008b502ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:15.813767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a85e8-a993-41af-bcfc-76008b502ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:15.814515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a85e8-a993-41af-bcfc-76008b502ed0 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=921658b1fa4940b68e10bf50c55717b8, user.id=5c6d1fefc8fe49269c39123e269420bc) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:25:15.814849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a85e8-a993-41af-bcfc-76008b502ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:15.816263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a85e8-a993-41af-bcfc-76008b502ed0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:15.822236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 589/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:25:15 2022] GET /identity/v3/role_assignments?user.id=5c6d1fefc8fe49269c39123e269420bc&scope.project.id=921658b1fa4940b68e10bf50c55717b8&role.id=45149274288845b0a73e18fbb3394202 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:17.787192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b89dc-44f9-4b53-b3de-29aebe994c82 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:17.821050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b89dc-44f9-4b53-b3de-29aebe994c82 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:17.821050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b89dc-44f9-4b53-b3de-29aebe994c82 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:17.821050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 597/1186] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:25:17.821491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09947-7497-4c14-b805-f06475eeb525 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:17.821491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09947-7497-4c14-b805-f06475eeb525 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:17.821491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09947-7497-4c14-b805-f06475eeb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:17.821491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7ca09947-7497-4c14-b805-f06475eeb525 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:25:17.821491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7ca09947-7497-4c14-b805-f06475eeb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:25:17.879296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 590/1187] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:25:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 08:25:17.901154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b89dc-44f9-4b53-b3de-29aebe994c82 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:17.941002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:18.007064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b89dc-44f9-4b53-b3de-29aebe994c82 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:18.041059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c7dd9-e6ac-40a9-8ce8-ad1e4dd6d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:18.041609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c7dd9-e6ac-40a9-8ce8-ad1e4dd6d28a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:18.041884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c7dd9-e6ac-40a9-8ce8-ad1e4dd6d28a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:18.042152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c7dd9-e6ac-40a9-8ce8-ad1e4dd6d28a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:18.051857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c7dd9-e6ac-40a9-8ce8-ad1e4dd6d28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-cc4c7dd9-e6ac-40a9-8ce8-ad1e4dd6d28a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:25:18.056456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:25:18.057655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:25:18.058987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 598/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:25:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:25:18.063623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca09947-7497-4c14-b805-f06475eeb525 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:18.122478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:18.158290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca09947-7497-4c14-b805-f06475eeb525 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:18.189858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:18.190451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:18.190752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:18.191020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:18.191668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:25:18.192217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:18.194055 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:18.201657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 591/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:18.207445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c7dd9-e6ac-40a9-8ce8-ad1e4dd6d28a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:18.300443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:18.304079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c7dd9-e6ac-40a9-8ce8-ad1e4dd6d28a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:18.337057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f218c7-e968-415f-bb64-e523f2c12c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:18.337664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f218c7-e968-415f-bb64-e523f2c12c38 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:18.338126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f218c7-e968-415f-bb64-e523f2c12c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:18.338703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f218c7-e968-415f-bb64-e523f2c12c38 None admin] PATH_INFO: `/v3/users/5c6d1fefc8fe49269c39123e269420bc` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:18.339820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f218c7-e968-415f-bb64-e523f2c12c38 None admin] RBAC: Authorizing `identity:get_user(user_id=5c6d1fefc8fe49269c39123e269420bc)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:18.341233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f218c7-e968-415f-bb64-e523f2c12c38 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:18.342806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 599/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:25:18 2022] GET /identity/v3/users/5c6d1fefc8fe49269c39123e269420bc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:18.348548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:18.442871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7c91-2cfd-462b-ae3d-277db623a74e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:18.466685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:18.474733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc10b99-5b6a-4d56-9d80-3fd4579f1134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:18.478236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10b99-5b6a-4d56-9d80-3fd4579f1134 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:18.478236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10b99-5b6a-4d56-9d80-3fd4579f1134 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:18.478236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc10b99-5b6a-4d56-9d80-3fd4579f1134 None admin] PATH_INFO: `/v3/projects/921658b1fa4940b68e10bf50c55717b8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:18.478236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc10b99-5b6a-4d56-9d80-3fd4579f1134 None admin] RBAC: Authorizing `identity:get_project(project_id=921658b1fa4940b68e10bf50c55717b8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:18.478592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc10b99-5b6a-4d56-9d80-3fd4579f1134 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:18.479906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 592/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:25:18 2022] GET /identity/v3/projects/921658b1fa4940b68e10bf50c55717b8 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:18.485674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f218c7-e968-415f-bb64-e523f2c12c38 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:18.582397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f218c7-e968-415f-bb64-e523f2c12c38 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:18.614791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112d7b-be33-4d83-8db1-ee3607d7a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:18.615426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112d7b-be33-4d83-8db1-ee3607d7a29c None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:18.615701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112d7b-be33-4d83-8db1-ee3607d7a29c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:18.615966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112d7b-be33-4d83-8db1-ee3607d7a29c None admin] PATH_INFO: `/v3/projects/921658b1fa4940b68e10bf50c55717b8/users/5c6d1fefc8fe49269c39123e269420bc/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:18.617850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0112d7b-be33-4d83-8db1-ee3607d7a29c None admin] RBAC: Authorizing `identity:create_grant(project_id=921658b1fa4940b68e10bf50c55717b8, user_id=5c6d1fefc8fe49269c39123e269420bc, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:18.619291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0112d7b-be33-4d83-8db1-ee3607d7a29c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:18.702232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 600/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:25:18 2022] PUT /identity/v3/projects/921658b1fa4940b68e10bf50c55717b8/users/5c6d1fefc8fe49269c39123e269420bc/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:25:20.654645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845015f-c00d-471c-8974-17da758362ed None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:20.655192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845015f-c00d-471c-8974-17da758362ed None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:20.655192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845015f-c00d-471c-8974-17da758362ed None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:20.656570 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 593/1193] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:25:20.662076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75b74-6852-4e9c-8133-7f2c41c784fe None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:20.662460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75b74-6852-4e9c-8133-7f2c41c784fe None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:20.662658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75b74-6852-4e9c-8133-7f2c41c784fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:20.680674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b5d75b74-6852-4e9c-8133-7f2c41c784fe None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:25:20.681849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b5d75b74-6852-4e9c-8133-7f2c41c784fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:25:20.701154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:20.745229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 601/1194] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:25:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:25:20.767747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845015f-c00d-471c-8974-17da758362ed None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:20.867786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845015f-c00d-471c-8974-17da758362ed None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:20.900253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33661-e661-4ccb-a929-4a993638d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:20.900866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33661-e661-4ccb-a929-4a993638d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:20.901142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33661-e661-4ccb-a929-4a993638d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:20.901411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33661-e661-4ccb-a929-4a993638d9c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:20.911815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b33661-e661-4ccb-a929-4a993638d9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-51b33661-e661-4ccb-a929-4a993638d9c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:25:20.916361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:25:20.917452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:25:20.918549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 594/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:25:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:25:20.923352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d75b74-6852-4e9c-8133-7f2c41c784fe None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:21.017843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d75b74-6852-4e9c-8133-7f2c41c784fe None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:21.050946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:21.051538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:21.051840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:21.052112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:21.052770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:25:21.053072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:21.054422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:21.062140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 602/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:21.068051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33661-e661-4ccb-a929-4a993638d9c0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:21.121946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:21.165558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33661-e661-4ccb-a929-4a993638d9c0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:21.197548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcce32b-baa6-4223-8eed-a807a4863ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:21.198159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcce32b-baa6-4223-8eed-a807a4863ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:21.198430 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcce32b-baa6-4223-8eed-a807a4863ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:21.198733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcce32b-baa6-4223-8eed-a807a4863ea9 None admin] PATH_INFO: `/v3/users/5c6d1fefc8fe49269c39123e269420bc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:21.199849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcce32b-baa6-4223-8eed-a807a4863ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=5c6d1fefc8fe49269c39123e269420bc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:21.201260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcce32b-baa6-4223-8eed-a807a4863ea9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:21.202896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 595/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 10 08:25:21 2022] GET /identity/v3/users/5c6d1fefc8fe49269c39123e269420bc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:25:21.209145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:21.227942 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:21.305201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6101-3f97-4e00-b24e-01ca0cd78c98 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:21.338571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df017368-aafd-4ff1-8aa2-186180f276c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:21.339152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017368-aafd-4ff1-8aa2-186180f276c8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:21.339425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017368-aafd-4ff1-8aa2-186180f276c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:21.339689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017368-aafd-4ff1-8aa2-186180f276c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:21.403589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df017368-aafd-4ff1-8aa2-186180f276c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:21.405004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df017368-aafd-4ff1-8aa2-186180f276c8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:21.422106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:21.498956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 603/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:25:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:25:21.504737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcce32b-baa6-4223-8eed-a807a4863ea9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:21.603223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcce32b-baa6-4223-8eed-a807a4863ea9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:21.624687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:21.636286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c0510-1b7f-4cd0-ab4c-949228eec14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:21.654383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0510-1b7f-4cd0-ab4c-949228eec14b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:21.654383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0510-1b7f-4cd0-ab4c-949228eec14b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:21.654383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0510-1b7f-4cd0-ab4c-949228eec14b None admin] PATH_INFO: `/v3/projects/921658b1fa4940b68e10bf50c55717b8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:21.654383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c0510-1b7f-4cd0-ab4c-949228eec14b None admin] RBAC: Authorizing `identity:get_project(project_id=921658b1fa4940b68e10bf50c55717b8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:21.654383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c0510-1b7f-4cd0-ab4c-949228eec14b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:21.654383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 596/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 10 08:25:21 2022] GET /identity/v3/projects/921658b1fa4940b68e10bf50c55717b8 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:21.655373 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df017368-aafd-4ff1-8aa2-186180f276c8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:25:21.742164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df017368-aafd-4ff1-8aa2-186180f276c8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:25:21.759055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:21.775096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3184f-4d5b-4951-a051-1f6be4c942e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:25:21.775678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3184f-4d5b-4951-a051-1f6be4c942e4 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:25:21.775952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3184f-4d5b-4951-a051-1f6be4c942e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:25:21.776220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3184f-4d5b-4951-a051-1f6be4c942e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:25:21.776935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3184f-4d5b-4951-a051-1f6be4c942e4 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=921658b1fa4940b68e10bf50c55717b8, user.id=5c6d1fefc8fe49269c39123e269420bc) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:25:21.777239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3184f-4d5b-4951-a051-1f6be4c942e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:25:21.778690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3184f-4d5b-4951-a051-1f6be4c942e4 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:25:21.784151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 604/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:25:21 2022] GET /identity/v3/role_assignments?user.id=5c6d1fefc8fe49269c39123e269420bc&scope.project.id=921658b1fa4940b68e10bf50c55717b8&role.id=45149274288845b0a73e18fbb3394202 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:25:31.669250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:25:31.812430 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=9 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:32.586813 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4bb2-f965-4dba-a291-f22ea17c06c0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:32.587406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4bb2-f965-4dba-a291-f22ea17c06c0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:32.587406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e4bb2-f965-4dba-a291-f22ea17c06c0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:32.588699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 597/1201] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:26:32.593705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1008d98-8704-41e6-b099-505e901ce433 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:32.594108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1008d98-8704-41e6-b099-505e901ce433 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:32.594266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1008d98-8704-41e6-b099-505e901ce433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:32.612893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-e1008d98-8704-41e6-b099-505e901ce433 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:26:32.614070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e1008d98-8704-41e6-b099-505e901ce433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:26:32.679310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 605/1202] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:26:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:26:32.703396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e4bb2-f965-4dba-a291-f22ea17c06c0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:32.802460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e4bb2-f965-4dba-a291-f22ea17c06c0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:32.834707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:32.835839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:32.836111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:32.836377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:32.846047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:32.847437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:32.862081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:32.870598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:32.871851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:32.871851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:32.871851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:32.871851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 598/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:32.872156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1008d98-8704-41e6-b099-505e901ce433 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:32.967142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1008d98-8704-41e6-b099-505e901ce433 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:32.994288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:33.000035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031e394-274a-4d7a-9065-3e293f83204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:33.002647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e394-274a-4d7a-9065-3e293f83204f None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:33.002647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e394-274a-4d7a-9065-3e293f83204f None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:33.002647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e394-274a-4d7a-9065-3e293f83204f None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:33.002647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031e394-274a-4d7a-9065-3e293f83204f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:33.002647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031e394-274a-4d7a-9065-3e293f83204f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:33.003440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031e394-274a-4d7a-9065-3e293f83204f None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:33.014570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 606/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:33.020254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:33.071654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:33.118298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55879e39-ca6a-4084-b54d-3753581f2fe6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:33.151018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9bbd-b3de-4ed3-b224-ec2e0a40e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:33.151653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9bbd-b3de-4ed3-b224-ec2e0a40e88f None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:33.151926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9bbd-b3de-4ed3-b224-ec2e0a40e88f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:33.152189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9bbd-b3de-4ed3-b224-ec2e0a40e88f None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:33.152849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9bbd-b3de-4ed3-b224-ec2e0a40e88f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:33.154269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9bbd-b3de-4ed3-b224-ec2e0a40e88f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:33.221040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 599/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 10 08:26:33 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:26:35.224884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827bc4-59e3-43f3-9109-ad119b790aee None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:35.225399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827bc4-59e3-43f3-9109-ad119b790aee None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:35.225399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827bc4-59e3-43f3-9109-ad119b790aee None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:35.227271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 607/1206] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:26:35.232675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981773c1-2c67-4c6f-9d9d-407da53c8339 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:35.233101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981773c1-2c67-4c6f-9d9d-407da53c8339 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:35.233261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981773c1-2c67-4c6f-9d9d-407da53c8339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:35.251637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-981773c1-2c67-4c6f-9d9d-407da53c8339 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:26:35.252811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-981773c1-2c67-4c6f-9d9d-407da53c8339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:26:35.317709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 600/1207] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:26:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:26:35.340994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a827bc4-59e3-43f3-9109-ad119b790aee None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:35.441295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a827bc4-59e3-43f3-9109-ad119b790aee None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:35.473336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9dcf-51aa-4f1e-ad2a-f1df80997a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:35.473953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9dcf-51aa-4f1e-ad2a-f1df80997a03 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:35.474224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9dcf-51aa-4f1e-ad2a-f1df80997a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:35.474513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f9dcf-51aa-4f1e-ad2a-f1df80997a03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:35.485167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f9dcf-51aa-4f1e-ad2a-f1df80997a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-631f9dcf-51aa-4f1e-ad2a-f1df80997a03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:26:35.489737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:35.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:35.491838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 608/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:26:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:35.497824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981773c1-2c67-4c6f-9d9d-407da53c8339 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:35.535886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:35.593727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981773c1-2c67-4c6f-9d9d-407da53c8339 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:35.626696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:35.627294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:35.627571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:35.627840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:35.628522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:35.628824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:35.630181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:35.639272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 601/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:35.649728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9dcf-51aa-4f1e-ad2a-f1df80997a03 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:35.698238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:35.748333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f9dcf-51aa-4f1e-ad2a-f1df80997a03 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:35.781895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:35.782536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:35.782814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:35.783082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:35.793889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:35.795379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:35.808911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:35.810003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:35.811324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:35.811324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:35.811324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:35.811324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 609/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:35.816098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:35.910751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:35.913583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e190f-7b95-4492-9024-c0e60f2dbbdc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:35.947389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:35.947996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:35.948276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:35.948546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:35.949186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:35.949487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:35.950993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:35.962864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 602/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:35.968511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:36.064923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c638ea-f85c-4dd1-9827-4ed95149e441 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:36.066384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:36.097685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:36.098288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:36.098590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:36.098858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:36.105914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:36.107348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:26:36.117958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:36.119124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:36.120306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 610/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:36.125155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:36.225283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1bb1e-0aa4-48f6-ae50-1e17073e966b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:36.256916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:36.257518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:36.257770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:36.258561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:36.259286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:36.259589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:36.261005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:36.277843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 603/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 10 08:26:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:36.283699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:36.379757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c327ac-8251-4878-aae6-b648f4308a53 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:36.412751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e897c-1244-4ba1-acb2-daf1c6ca4b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:36.413342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e897c-1244-4ba1-acb2-daf1c6ca4b0e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:36.413653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e897c-1244-4ba1-acb2-daf1c6ca4b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:36.413917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e897c-1244-4ba1-acb2-daf1c6ca4b0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:36.443761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:36.480182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e897c-1244-4ba1-acb2-daf1c6ca4b0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:36.481596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e897c-1244-4ba1-acb2-daf1c6ca4b0e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:36.577984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 611/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:26:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:26:36.583864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:36.602245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:36.679435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a5635-849c-4fc7-ad80-95462a9e97d7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:36.714335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:36.715165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:36.715282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:36.715564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:36.725317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:36.727287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:36.741153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:36.749175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:36.750291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:36.750291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:36.750291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:36.750291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 604/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:36.750609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e897c-1244-4ba1-acb2-daf1c6ca4b0e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:36.807678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:36.843515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e897c-1244-4ba1-acb2-daf1c6ca4b0e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:36.878926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:36.879527 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:36.879807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:36.880076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:36.880742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:36.881046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:36.882488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:36.893900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 612/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:36.899575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:36.967953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:36.998683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395f12b-c9db-43d4-9a12-10b9d294b7de None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:37.031359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:37.032006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:37.032278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:37.032550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:37.039021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:37.041001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:26:37.052041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:37.053125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:37.054393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 605/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:37.059547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:37.158988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ba021-0c33-4f39-bc03-efcf76a1db43 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:37.181296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:37.192504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95971ef-2dda-49e8-ba17-786dd4171cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:37.193137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95971ef-2dda-49e8-ba17-786dd4171cde None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:37.193360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95971ef-2dda-49e8-ba17-786dd4171cde None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:37.193623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95971ef-2dda-49e8-ba17-786dd4171cde None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:37.194297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95971ef-2dda-49e8-ba17-786dd4171cde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:37.194624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95971ef-2dda-49e8-ba17-786dd4171cde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:37.196032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95971ef-2dda-49e8-ba17-786dd4171cde None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:37.207571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 613/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:37.214112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:37.311478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c8438-4c94-4a69-aa7c-ae1be42dd8f6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:37.339141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:37.345030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83848b-ac17-4596-9d50-10b50787520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:37.345628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83848b-ac17-4596-9d50-10b50787520b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:37.345904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83848b-ac17-4596-9d50-10b50787520b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:37.346174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83848b-ac17-4596-9d50-10b50787520b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:37.346921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83848b-ac17-4596-9d50-10b50787520b None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=f9f08c0a99674a849035dc0b44e62e6d) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:37.347225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83848b-ac17-4596-9d50-10b50787520b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:37.348637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83848b-ac17-4596-9d50-10b50787520b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:37.354647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 606/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:26:37 2022] GET /identity/v3/role_assignments?user.id=f9f08c0a99674a849035dc0b44e62e6d&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:39.298447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929d4f-a61a-4653-ae2d-a7c83d51eb14 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:39.298997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929d4f-a61a-4653-ae2d-a7c83d51eb14 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:39.298997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929d4f-a61a-4653-ae2d-a7c83d51eb14 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:39.300321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 614/1220] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:26:39.305809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfe61-8985-4f1a-b753-bcc82170e1eb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:39.306204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfe61-8985-4f1a-b753-bcc82170e1eb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:39.306350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfe61-8985-4f1a-b753-bcc82170e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:39.324749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-663cfe61-8985-4f1a-b753-bcc82170e1eb None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:26:39.325932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-663cfe61-8985-4f1a-b753-bcc82170e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:26:39.390454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 607/1221] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:26:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:26:39.412014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929d4f-a61a-4653-ae2d-a7c83d51eb14 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:39.513915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929d4f-a61a-4653-ae2d-a7c83d51eb14 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:39.548946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84714ecb-ad79-4402-a73b-19226ca4e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:39.549503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84714ecb-ad79-4402-a73b-19226ca4e43e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:39.549781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84714ecb-ad79-4402-a73b-19226ca4e43e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:39.550052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84714ecb-ad79-4402-a73b-19226ca4e43e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:39.560402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84714ecb-ad79-4402-a73b-19226ca4e43e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-84714ecb-ad79-4402-a73b-19226ca4e43e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:26:39.565315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:39.566403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:39.567513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 615/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:26:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:39.573072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cfe61-8985-4f1a-b753-bcc82170e1eb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:39.667274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cfe61-8985-4f1a-b753-bcc82170e1eb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:39.690163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:39.700273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:39.700863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:39.701139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:39.701407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:39.702063 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:39.702360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:39.703737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:39.711281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 608/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:26:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:26:39.717165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84714ecb-ad79-4402-a73b-19226ca4e43e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:39.761324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:39.817310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84714ecb-ad79-4402-a73b-19226ca4e43e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:39.848853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:39.849466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:39.849741 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:39.850007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:39.860794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:39.868440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:39.876872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:39.878018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:39.879201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:39.879201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:39.879201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:39.879201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 616/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:39.883940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:39.983183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9ecc-5197-49e0-8f51-c6dc628061a9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:40.015457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:40.016044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:40.016318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:40.016585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:40.017217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:40.017513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:40.018885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:40.030047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 609/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:40.036106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:40.129389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:40.135882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3eff-a080-4802-9b1e-a1cf52b88383 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:40.168956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:40.169571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:40.169849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:40.170118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:40.177528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:40.179030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:26:40.190183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:40.191518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:40.192661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 617/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:40.197340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:40.244389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:40.296667 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb91143-2b33-461c-92b7-a3f076b6c9d5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:40.328670 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:40.329266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:40.329541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:40.329812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:40.330560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:40.330865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:40.332280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:40.349069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 610/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 10 08:26:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:40.355305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:40.454251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c62b0-3f94-4d9a-b7c3-7dafce603d32 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:40.487176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:40.487785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:40.488056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:40.488322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:40.498429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:40.499904 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:40.513708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:40.514901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:40.515818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:40.515818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:40.515818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:40.515818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 618/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:40.520516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:40.616456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e56ae-f014-49e7-8495-8b638a39ed10 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:40.618844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:40.650956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:40.651549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:40.651821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:40.652087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:40.652750 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:40.653045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:40.654403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:40.665266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 611/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:40.670950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:40.680655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:40.770061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ec17f-1c41-4160-8da2-e8f3d100683b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:40.803332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:40.803945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:40.804222 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:40.804491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:40.811554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:40.813032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:26:40.824680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:40.825739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:40.826757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 619/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:26:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:40.831714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:40.927831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49da39-83d9-43b4-8e0f-bb42c1f0c302 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:40.961922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7adbbb-a19a-4aaa-ac41-fc3efc0c5b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:40.962545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7adbbb-a19a-4aaa-ac41-fc3efc0c5b48 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:40.962821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7adbbb-a19a-4aaa-ac41-fc3efc0c5b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:40.963121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7adbbb-a19a-4aaa-ac41-fc3efc0c5b48 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:40.963805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7adbbb-a19a-4aaa-ac41-fc3efc0c5b48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:40.964108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7adbbb-a19a-4aaa-ac41-fc3efc0c5b48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:40.965679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7adbbb-a19a-4aaa-ac41-fc3efc0c5b48 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:40.977462 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 612/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:40.983440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:41.047849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:41.081889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2abef8-8433-457c-894e-bea8f44f8f96 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:41.113435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0df29-8920-4a21-acd1-04ea2eec4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:41.114068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0df29-8920-4a21-acd1-04ea2eec4b40 None admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:41.114341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0df29-8920-4a21-acd1-04ea2eec4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:41.114639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0df29-8920-4a21-acd1-04ea2eec4b40 None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/f9f08c0a99674a849035dc0b44e62e6d/roles/2d8d67bb4f814a2da8c49bd7f01cf98e` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:41.128873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0df29-8920-4a21-acd1-04ea2eec4b40 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=f9f08c0a99674a849035dc0b44e62e6d, role_id=2d8d67bb4f814a2da8c49bd7f01cf98e)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:41.130333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0df29-8920-4a21-acd1-04ea2eec4b40 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:41.244901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 620/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:26:40 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/f9f08c0a99674a849035dc0b44e62e6d/roles/2d8d67bb4f814a2da8c49bd7f01cf98e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:26:43.204401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b0681-10dd-4375-91ba-9ca34dcf0898 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:43.204900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b0681-10dd-4375-91ba-9ca34dcf0898 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:43.204900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b0681-10dd-4375-91ba-9ca34dcf0898 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:43.206267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 613/1233] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:26:43.212203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a626-3309-44bd-bb39-3bf112e4dc1a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:43.212601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a626-3309-44bd-bb39-3bf112e4dc1a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:43.212733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a626-3309-44bd-bb39-3bf112e4dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:43.232089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3805a626-3309-44bd-bb39-3bf112e4dc1a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:26:43.233334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3805a626-3309-44bd-bb39-3bf112e4dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:26:43.299188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 621/1234] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:26:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:26:43.322218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b0681-10dd-4375-91ba-9ca34dcf0898 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:43.347330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:43.420987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b0681-10dd-4375-91ba-9ca34dcf0898 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:43.455395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d025e74-4ce5-4493-8c0f-f8e22574ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:43.455948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d025e74-4ce5-4493-8c0f-f8e22574ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:43.456256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d025e74-4ce5-4493-8c0f-f8e22574ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:43.456525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d025e74-4ce5-4493-8c0f-f8e22574ac0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:43.467160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d025e74-4ce5-4493-8c0f-f8e22574ac0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2d025e74-4ce5-4493-8c0f-f8e22574ac0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:26:43.472050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:43.473061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:43.474094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 614/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 10 08:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:43.479318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a626-3309-44bd-bb39-3bf112e4dc1a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:43.526150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:43.577334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a626-3309-44bd-bb39-3bf112e4dc1a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:43.611305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:43.611897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:43.612173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:43.612443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:43.613103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:43.613401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:43.614794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:43.623132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 622/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 10 08:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:43.628905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d025e74-4ce5-4493-8c0f-f8e22574ac0e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:43.711554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:43.726387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d025e74-4ce5-4493-8c0f-f8e22574ac0e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:43.759752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:43.762984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:43.762984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:43.762984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:43.770768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:43.772197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:43.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:43.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:43.789058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:43.789058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:43.789058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:43.789058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 615/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:43.793428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:43.893850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48938b-47a7-4171-9bf1-d8c6fede40d5 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:43.904801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:43.928745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:43.929341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:43.930154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:43.930424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:43.931093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:43.931389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:43.932769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:43.949532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 623/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:43.955266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:44.052827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef82e-55f3-4f36-a214-92e408bf228e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:44.086598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:44.087208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:44.087480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:44.087759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:44.090350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:44.094610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:44.097185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:26:44.106833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:44.107860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:44.108822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 616/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:44.113901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:44.212102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19136a0f-f74e-4331-9fe4-0e13ca12ac1a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:44.246936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:44.247618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:44.247787 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:44.248053 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:44.248774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:44.249073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:44.250509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:44.267140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 624/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 10 08:26:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:44.272915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:44.370141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dd9e4-5279-44cb-86c6-e1ad08efa1aa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:44.402049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77fe5-ed64-483c-9785-7c7c8c8b5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:44.402776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77fe5-ed64-483c-9785-7c7c8c8b5b0b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:44.403051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77fe5-ed64-483c-9785-7c7c8c8b5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:44.403317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77fe5-ed64-483c-9785-7c7c8c8b5b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:44.462090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:44.468153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f77fe5-ed64-483c-9785-7c7c8c8b5b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:44.469596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f77fe5-ed64-483c-9785-7c7c8c8b5b0b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:44.569176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 617/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:26:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:26:44.575159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:44.602795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:44.672101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d348fa-6844-4e32-86b6-cf526fb1b5cc None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:44.704623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:44.705235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:44.705504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:44.705767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:44.715768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:44.717182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:44.731589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:44.732691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:44.734215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:44.734215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:44.734215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:44.734215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 625/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:44.739260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77fe5-ed64-483c-9785-7c7c8c8b5b0b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:44.833935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:44.840747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77fe5-ed64-483c-9785-7c7c8c8b5b0b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:44.876504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:44.877178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:44.877455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:44.877722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:44.878352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:44.878675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:44.880082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:44.891592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 618/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:44.897577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:44.977722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:44.998301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c8ff-a830-4fe5-8081-0ed875b807dc None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:45.031949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:45.032563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:45.032835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:45.033100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:45.039513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:45.040921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:26:45.052488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:45.053553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:45.059535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 626/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:45.060463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:45.159557 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3df628-a239-40ee-9b3e-7a00cdd22aeb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:45.191635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8f341-d41e-4f16-ab2b-053b98329f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:45.192219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8f341-d41e-4f16-ab2b-053b98329f53 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:45.192489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8f341-d41e-4f16-ab2b-053b98329f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:45.192801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8f341-d41e-4f16-ab2b-053b98329f53 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:45.193428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8f341-d41e-4f16-ab2b-053b98329f53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:45.193726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8f341-d41e-4f16-ab2b-053b98329f53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:45.195695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8f341-d41e-4f16-ab2b-053b98329f53 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:45.208011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 619/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:45.214716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:45.310626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190acd81-1733-4127-a38f-01c8f050a409 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:45.343366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d6755-1486-4d0b-8295-9b29b0f5daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:45.343946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d6755-1486-4d0b-8295-9b29b0f5daeb None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:45.344218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d6755-1486-4d0b-8295-9b29b0f5daeb None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:45.344483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d6755-1486-4d0b-8295-9b29b0f5daeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:45.345222 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d6755-1486-4d0b-8295-9b29b0f5daeb None admin] RBAC: Adding query filter params (role.id=2d8d67bb4f814a2da8c49bd7f01cf98e, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=f9f08c0a99674a849035dc0b44e62e6d) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:45.345522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d6755-1486-4d0b-8295-9b29b0f5daeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:45.346972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d6755-1486-4d0b-8295-9b29b0f5daeb None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:45.352815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 627/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:26:45 2022] GET /identity/v3/role_assignments?user.id=f9f08c0a99674a849035dc0b44e62e6d&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=2d8d67bb4f814a2da8c49bd7f01cf98e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:47.408566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb469-0d5f-48d4-a146-e3dedf1c4b95 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:47.409089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb469-0d5f-48d4-a146-e3dedf1c4b95 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:47.409089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb469-0d5f-48d4-a146-e3dedf1c4b95 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:47.410386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 620/1247] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:26:47.416026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09c765-508c-4baa-bd09-f293c86c97d3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:47.416479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09c765-508c-4baa-bd09-f293c86c97d3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:47.416571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09c765-508c-4baa-bd09-f293c86c97d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:47.422969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:47.435582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ad09c765-508c-4baa-bd09-f293c86c97d3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:26:47.436754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ad09c765-508c-4baa-bd09-f293c86c97d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:26:47.499965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 628/1248] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:26:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:26:47.524375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fb469-0d5f-48d4-a146-e3dedf1c4b95 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:47.542374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:47.623169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fb469-0d5f-48d4-a146-e3dedf1c4b95 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:47.655425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5daaa1-02bb-432d-bf4f-2c99824be302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:47.656036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5daaa1-02bb-432d-bf4f-2c99824be302 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:47.656308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5daaa1-02bb-432d-bf4f-2c99824be302 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:47.656570 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5daaa1-02bb-432d-bf4f-2c99824be302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:47.666222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5daaa1-02bb-432d-bf4f-2c99824be302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bb5daaa1-02bb-432d-bf4f-2c99824be302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:26:47.670700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:47.671753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:47.672644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 621/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:26:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:47.678197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09c765-508c-4baa-bd09-f293c86c97d3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:47.774188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09c765-508c-4baa-bd09-f293c86c97d3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:47.801968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:47.807276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:47.807866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:47.808141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:47.808402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:47.809083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:47.809356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:47.810735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:47.818980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 629/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:26:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:47.825284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5daaa1-02bb-432d-bf4f-2c99824be302 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:47.901898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:47.923976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5daaa1-02bb-432d-bf4f-2c99824be302 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:47.957747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:47.958376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:47.958687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:47.958957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:47.968978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:47.970409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:47.984638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:47.985688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:47.986660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:47.986660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:47.986660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:47.986660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 622/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 08:26:47.991490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:48.089174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df9f5-412d-41a3-b180-729853fc3dd5 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:48.122112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:48.122779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:48.123038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:48.123299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:48.123921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:48.124214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:48.125554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:48.143619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 630/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:48.149457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:48.246712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626ed5-165e-4bd9-8e83-53d4a2edfb09 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:48.271137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:48.278761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:48.279385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:48.279659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:48.279925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:48.287134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:48.288573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:26:48.299629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:48.300749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:48.301945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 623/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:48.307101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:48.361638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:48.404802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a962206-0224-4d92-9c3b-1196ebe94256 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:48.438583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:48.439450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:48.439697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:48.439965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:48.440680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:48.440981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:48.442612 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:48.460305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 631/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 10 08:26:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:48.466997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:48.563367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b34d9-5abb-4aa3-8084-272ff771303f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:48.595823 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3023749-5460-4799-a341-24c772bd7ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:48.596394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023749-5460-4799-a341-24c772bd7ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:48.596668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023749-5460-4799-a341-24c772bd7ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:48.596932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023749-5460-4799-a341-24c772bd7ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:48.651408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:48.663156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3023749-5460-4799-a341-24c772bd7ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:48.665187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3023749-5460-4799-a341-24c772bd7ad5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:48.758661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 624/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:26:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:26:48.764390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:48.861495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc09e25-2f22-49b9-9894-d75aabb336e0 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:48.874296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:48.897157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:48.897731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:48.898025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:48.898843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:48.908643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:48.910144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:48.923992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:48.941239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:48.942170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:48.942170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:48.942170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:48.942170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 632/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:48.942521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3023749-5460-4799-a341-24c772bd7ad5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:49.065435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:49.065435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3023749-5460-4799-a341-24c772bd7ad5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:49.065435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:49.065435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:49.066369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:49.066369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:49.066369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:49.066369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:49.066369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:49.076184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 625/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:49.081920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:49.177500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50a748-87be-42f5-bcf3-e9394d2573ca None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:49.211632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:49.212243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:49.212518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:49.212782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:49.219054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:49.220508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:26:49.231874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:49.239543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:49.240759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 633/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:49.241488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:49.337395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605488-3f38-4699-965a-54b5ca21717b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:49.370273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2531863-59f0-48d6-8d40-d8abffd333ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:49.370893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531863-59f0-48d6-8d40-d8abffd333ab None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:49.371171 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531863-59f0-48d6-8d40-d8abffd333ab None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:49.371442 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531863-59f0-48d6-8d40-d8abffd333ab None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:49.372123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2531863-59f0-48d6-8d40-d8abffd333ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:49.372424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2531863-59f0-48d6-8d40-d8abffd333ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:49.374091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2531863-59f0-48d6-8d40-d8abffd333ab None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:49.386510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 626/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:49.392639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:49.418280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:49.490378 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5c069-b956-4faf-9540-584e95dd0046 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:49.524319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f954-5264-4769-8b68-74d9046e563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:49.524935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f954-5264-4769-8b68-74d9046e563b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:49.525208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f954-5264-4769-8b68-74d9046e563b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:49.525473 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f954-5264-4769-8b68-74d9046e563b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:49.526187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f954-5264-4769-8b68-74d9046e563b None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=f9f08c0a99674a849035dc0b44e62e6d) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:49.526538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f954-5264-4769-8b68-74d9046e563b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:49.527948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f954-5264-4769-8b68-74d9046e563b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:49.533066 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 634/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:26:49 2022] GET /identity/v3/role_assignments?user.id=f9f08c0a99674a849035dc0b44e62e6d&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=45149274288845b0a73e18fbb3394202 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:51.502165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd196c-d041-4ce8-98b3-90f2710a1a10 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:51.502801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd196c-d041-4ce8-98b3-90f2710a1a10 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:51.502801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd196c-d041-4ce8-98b3-90f2710a1a10 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:51.504122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 627/1261] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:26:51.509755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a27865-1d86-48fa-8e4c-06ec9ac7b1b3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:51.510174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a27865-1d86-48fa-8e4c-06ec9ac7b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:51.510311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a27865-1d86-48fa-8e4c-06ec9ac7b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:51.528110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-19a27865-1d86-48fa-8e4c-06ec9ac7b1b3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:26:51.529289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-19a27865-1d86-48fa-8e4c-06ec9ac7b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:26:51.596732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 635/1262] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:26:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:26:51.619094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd196c-d041-4ce8-98b3-90f2710a1a10 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:51.629769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:51.718991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd196c-d041-4ce8-98b3-90f2710a1a10 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:51.752932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec292f5-d4f2-442d-8941-67049f32e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:51.753489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec292f5-d4f2-442d-8941-67049f32e6ab None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:51.753766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec292f5-d4f2-442d-8941-67049f32e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:51.754036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec292f5-d4f2-442d-8941-67049f32e6ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:51.763963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec292f5-d4f2-442d-8941-67049f32e6ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9ec292f5-d4f2-442d-8941-67049f32e6ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:26:51.768528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:51.769716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:51.770692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 628/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:51.775820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a27865-1d86-48fa-8e4c-06ec9ac7b1b3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:51.794807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:51.874318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a27865-1d86-48fa-8e4c-06ec9ac7b1b3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:51.907401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:51.907995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:51.908266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:51.908529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:51.909186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:51.909479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:51.910851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:51.919118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 636/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:51.925134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec292f5-d4f2-442d-8941-67049f32e6ab None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:51.991155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:52.025415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec292f5-d4f2-442d-8941-67049f32e6ab None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:52.058378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:52.059019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:52.059296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:52.059563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:52.070574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:52.075295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:52.085501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:52.087219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:52.088561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:52.088561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:52.088561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:52.088561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 629/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:52.093219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:52.173331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:52.191914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2abba8-7a02-4d06-b24f-4a10153d668b None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:52.224311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:52.224896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:52.225192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:52.225435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:52.226073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:52.226956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:52.228524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:52.239585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 637/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:52.245267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:52.344795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bfe0-dc1a-4d4b-9a77-0c5edc3990a0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:52.363817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:52.377329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:52.377944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:52.378279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:52.378577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:52.385764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:52.387221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:26:52.397934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:52.399589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:52.400746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 630/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:52.405290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:52.504219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317453-4c3a-44a9-8590-d49d1e8c271a None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:52.537674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:52.538260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:52.538587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:52.539190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:52.539954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:52.540258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:52.541652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:52.549967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:52.558196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 638/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 10 08:26:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:52.564226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:52.664389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65128f-79f4-44df-96a3-694434456d26 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:52.697022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:52.697638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:52.697979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:52.698358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:52.708556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:52.710146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:52.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:52.727747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:52.728843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:52.728843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:52.728843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:52.728843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 631/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:52.731829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:52.830910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad47de9-8dea-46ea-9216-d9c7dfbd7c04 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:52.863227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:52.863816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:52.864089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:52.864355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:52.864986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:52.865281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:52.866673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:52.878046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 639/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:52.884359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:52.915509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:52.983761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93406eaa-2719-449e-a6a5-511d31792e6d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:53.016932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:53.017544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:53.017815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:53.018081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:53.024414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:53.025834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:26:53.036400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:53.037448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:53.038628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 632/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:53.043373 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:53.100531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:53.141795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1feb4e-8895-4ede-bb98-5f26394bd939 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:53.174231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98688679-b292-49e9-a4f8-6204182da478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:53.174852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98688679-b292-49e9-a4f8-6204182da478 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:53.175127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98688679-b292-49e9-a4f8-6204182da478 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:53.175390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98688679-b292-49e9-a4f8-6204182da478 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:53.176075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98688679-b292-49e9-a4f8-6204182da478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:53.176373 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98688679-b292-49e9-a4f8-6204182da478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:53.177783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98688679-b292-49e9-a4f8-6204182da478 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:53.190756 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 640/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:53.196780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:53.286693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:53.295889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4577-d8fb-4db0-baad-1a2e5dd9f112 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:53.328321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adf145-779d-4217-8665-a021a4180d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:53.328970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf145-779d-4217-8665-a021a4180d4b None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:53.329243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf145-779d-4217-8665-a021a4180d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:53.329514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf145-779d-4217-8665-a021a4180d4b None admin] PATH_INFO: `/v3/projects/6bada15b997f4ff881215a35b1569324/users/f9f08c0a99674a849035dc0b44e62e6d/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:53.331447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adf145-779d-4217-8665-a021a4180d4b None admin] RBAC: Authorizing `identity:create_grant(project_id=6bada15b997f4ff881215a35b1569324, user_id=f9f08c0a99674a849035dc0b44e62e6d, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:53.332874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adf145-779d-4217-8665-a021a4180d4b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:53.415663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 633/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 10 08:26:53 2022] PUT /identity/v3/projects/6bada15b997f4ff881215a35b1569324/users/f9f08c0a99674a849035dc0b44e62e6d/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:26:55.373675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a4c1a-f3c3-41a3-8e8b-c33321693704 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:55.374225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a4c1a-f3c3-41a3-8e8b-c33321693704 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:55.374225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a4c1a-f3c3-41a3-8e8b-c33321693704 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:55.375584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 641/1274] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:26:55.380979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6df56-ce80-46e4-8236-0464baf29749 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:55.381462 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6df56-ce80-46e4-8236-0464baf29749 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:55.381556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6df56-ce80-46e4-8236-0464baf29749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:55.399839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1ef6df56-ce80-46e4-8236-0464baf29749 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:26:55.401030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1ef6df56-ce80-46e4-8236-0464baf29749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:26:55.468643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 634/1275] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:26:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:26:55.491195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a4c1a-f3c3-41a3-8e8b-c33321693704 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:55.592021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a4c1a-f3c3-41a3-8e8b-c33321693704 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:55.609920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:55.632889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6ed9b-359d-4b0d-bb9a-32b525ab4469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:55.632889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6ed9b-359d-4b0d-bb9a-32b525ab4469 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:55.632889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6ed9b-359d-4b0d-bb9a-32b525ab4469 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:55.632889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6ed9b-359d-4b0d-bb9a-32b525ab4469 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:55.637256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6ed9b-359d-4b0d-bb9a-32b525ab4469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-7ab6ed9b-359d-4b0d-bb9a-32b525ab4469 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 08:26:55.641813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:55.642935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:55.643969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 642/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 10 08:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:55.649569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6df56-ce80-46e4-8236-0464baf29749 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:55.730140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:55.747705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6df56-ce80-46e4-8236-0464baf29749 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:55.781178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:55.781774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:55.782047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:55.782315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:55.783002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:55.783300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:55.784712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:55.792343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 635/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 10 08:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:55.798183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6ed9b-359d-4b0d-bb9a-32b525ab4469 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:55.896711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6ed9b-359d-4b0d-bb9a-32b525ab4469 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:55.930515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:55.931145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:55.931418 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:55.931680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:55.942362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:55.943823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:55.957940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:55.959171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:55.960432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:55.960432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:55.960432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:55.960432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 643/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:55.964747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:56.068015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a8919-3cd4-468a-9657-8cbc6312de8c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:56.100264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:56.100860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:56.101153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:56.101422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:56.102083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:56.102415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:56.105828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:56.115207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 636/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:56.121391 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:56.152406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:56.220036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c7c8b-fb23-490a-89a3-ec78cf6c3efc None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:56.254101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:56.254750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:56.255028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:56.255294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:56.262619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:56.264036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 08:26:56.274608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:56.275733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:56.276727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 644/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:56.281456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:56.285271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:56.377940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abf477-cb01-4866-8efa-f45c8286c5fa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:56.410038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:56.410679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:56.410860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:56.411128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:56.411846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:56.412147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:56.414340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:56.433466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 637/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 10 08:26:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:56.439411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:56.526913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:56.536087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7336c-ac29-4f43-8ef8-6bd37355a312 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:56.569302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc56fe-133e-47af-94b2-c76ba6491a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:56.569897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc56fe-133e-47af-94b2-c76ba6491a6c None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:56.570172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc56fe-133e-47af-94b2-c76ba6491a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:56.570439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc56fe-133e-47af-94b2-c76ba6491a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:56.635220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc56fe-133e-47af-94b2-c76ba6491a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:56.636699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc56fe-133e-47af-94b2-c76ba6491a6c None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:56.723113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:56.733478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 645/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 10 08:26:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 08:26:56.739260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:56.800564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:56.839545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758e2a4-f9bf-451f-98e4-4e3fef52d54f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:56.871949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:56.872574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:56.872826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:56.873091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:56.883175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:56.884589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 08:26:56.899018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:56.904222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 08:26:56.905320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 08:26:56.905320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 08:26:56.905320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:56.905320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 638/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:56.905894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc56fe-133e-47af-94b2-c76ba6491a6c None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:57.003881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc56fe-133e-47af-94b2-c76ba6491a6c None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:57.037171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:57.037760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:57.038030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:57.038290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:57.038976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:57.039268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:57.040611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:57.051330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 646/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 10 08:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:57.056966 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:57.154170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8ba6-58b6-4ca9-9146-e1660ad603f8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:57.167124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:57.186814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:57.187434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:57.187705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:57.188111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:57.195307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:57.196741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 08:26:57.207409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:57.208356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: ERROR keystone.server.flask.application Aug 10 08:26:57.209335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 639/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 10 08:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:57.214998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:57.263530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:57.313197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42deec3-68a0-4027-9027-0bfa26657e4e None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:57.346650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc89bd-3c59-48c5-8998-9fbfdef74fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:57.347241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc89bd-3c59-48c5-8998-9fbfdef74fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:57.347515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc89bd-3c59-48c5-8998-9fbfdef74fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:57.347786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc89bd-3c59-48c5-8998-9fbfdef74fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:57.348461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc89bd-3c59-48c5-8998-9fbfdef74fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:57.348758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc89bd-3c59-48c5-8998-9fbfdef74fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:57.350162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc89bd-3c59-48c5-8998-9fbfdef74fc2 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:57.361999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 647/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 10 08:26:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:57.368542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:57.467477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371d048-4f81-47f8-8e0b-4d7fac3696ad None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:57.500367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e496d-b7cd-4821-ba35-e00c64bc7ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:57.500960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e496d-b7cd-4821-ba35-e00c64bc7ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:57.501237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e496d-b7cd-4821-ba35-e00c64bc7ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:57.501507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e496d-b7cd-4821-ba35-e00c64bc7ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:57.502227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e496d-b7cd-4821-ba35-e00c64bc7ec0 None admin] RBAC: Adding query filter params (role.id=45149274288845b0a73e18fbb3394202, scope.project.id=6bada15b997f4ff881215a35b1569324, user.id=f9f08c0a99674a849035dc0b44e62e6d) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:57.502562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e496d-b7cd-4821-ba35-e00c64bc7ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:57.503998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e496d-b7cd-4821-ba35-e00c64bc7ec0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:57.510297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 640/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 10 08:26:57 2022] GET /identity/v3/role_assignments?user.id=f9f08c0a99674a849035dc0b44e62e6d&scope.project.id=6bada15b997f4ff881215a35b1569324&role.id=45149274288845b0a73e18fbb3394202 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:59.535944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd99f-f73a-49f3-a2ed-bba126379593 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:59.536500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd99f-f73a-49f3-a2ed-bba126379593 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:59.536500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd99f-f73a-49f3-a2ed-bba126379593 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:59.537819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 648/1288] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:26:59.542942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6a9b-6418-4b9e-a3b8-11f032590847 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:59.543965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6a9b-6418-4b9e-a3b8-11f032590847 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:59.543965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6a9b-6418-4b9e-a3b8-11f032590847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:59.561876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-896e6a9b-6418-4b9e-a3b8-11f032590847 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:26:59.563091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-896e6a9b-6418-4b9e-a3b8-11f032590847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:26:59.593790 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:59.631120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 641/1289] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:26:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:26:59.653201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bd99f-f73a-49f3-a2ed-bba126379593 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:59.753263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bd99f-f73a-49f3-a2ed-bba126379593 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:59.764220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:26:59.786336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:59.786917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:59.787187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:59.787449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:59.788015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:59.789381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:26:59.797703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:26:59.798878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:26:59.799774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 649/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:26:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:26:59.805368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e6a9b-6418-4b9e-a3b8-11f032590847 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:26:59.901101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e6a9b-6418-4b9e-a3b8-11f032590847 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:26:59.938361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de834eea-d0af-4ee6-b6ba-10bd86eba5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:26:59.939262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de834eea-d0af-4ee6-b6ba-10bd86eba5be None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:26:59.939537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de834eea-d0af-4ee6-b6ba-10bd86eba5be None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:26:59.939806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de834eea-d0af-4ee6-b6ba-10bd86eba5be None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:26:59.940438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de834eea-d0af-4ee6-b6ba-10bd86eba5be None admin] RBAC: Adding query filter params (name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:26:59.940734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de834eea-d0af-4ee6-b6ba-10bd86eba5be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:26:59.942088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de834eea-d0af-4ee6-b6ba-10bd86eba5be None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:26:59.946972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 642/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Aug 10 08:26:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:26:59.952665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:00.055471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fe833-3bcb-436e-b98f-28b2ad8e97a2 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:00.089359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed1d60-a059-40cd-9adc-df59490e783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:00.089948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1d60-a059-40cd-9adc-df59490e783d None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:00.090226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1d60-a059-40cd-9adc-df59490e783d None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:00.090505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1d60-a059-40cd-9adc-df59490e783d None admin] PATH_INFO: `/v3/services` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:00.091124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed1d60-a059-40cd-9adc-df59490e783d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:27:00.091418 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed1d60-a059-40cd-9adc-df59490e783d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:00.092781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed1d60-a059-40cd-9adc-df59490e783d None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:00.097054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 650/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Aug 10 08:26:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:27:02.099050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6b41-f34b-464e-b319-2199df1f4f02 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:02.099602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6b41-f34b-464e-b319-2199df1f4f02 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:02.099602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6b41-f34b-464e-b319-2199df1f4f02 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:02.100969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 643/1293] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:27:02.106453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ef13-6b1b-42f3-b821-4aa23d119cb8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:02.106918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ef13-6b1b-42f3-b821-4aa23d119cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:02.107026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ef13-6b1b-42f3-b821-4aa23d119cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:02.124742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d2b7ef13-6b1b-42f3-b821-4aa23d119cb8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:27:02.125902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d2b7ef13-6b1b-42f3-b821-4aa23d119cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:27:02.155237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:27:02.190898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 651/1294] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:27:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:27:02.214261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e6b41-f34b-464e-b319-2199df1f4f02 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:02.244277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:27:02.311600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e6b41-f34b-464e-b319-2199df1f4f02 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:02.344784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b6b8-f478-4b76-9cce-d0727f65aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:02.345373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b6b8-f478-4b76-9cce-d0727f65aba3 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:02.345642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b6b8-f478-4b76-9cce-d0727f65aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:02.345910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b6b8-f478-4b76-9cce-d0727f65aba3 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:02.346569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b6b8-f478-4b76-9cce-d0727f65aba3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:02.350737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b6b8-f478-4b76-9cce-d0727f65aba3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:02.483561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 644/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 10 08:27:02 2022] POST /identity/v3/services => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:27:04.440067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779479-18bf-4269-9a1c-ff562e95782b None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:04.440592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779479-18bf-4269-9a1c-ff562e95782b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:04.440592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779479-18bf-4269-9a1c-ff562e95782b None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:04.441985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 652/1296] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:27:04.447345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc3035-d1fc-4214-85b0-026ac0ab7e2d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:04.447836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc3035-d1fc-4214-85b0-026ac0ab7e2d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:04.447929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc3035-d1fc-4214-85b0-026ac0ab7e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:04.465296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b3cc3035-d1fc-4214-85b0-026ac0ab7e2d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:27:04.470499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b3cc3035-d1fc-4214-85b0-026ac0ab7e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:27:04.537082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 645/1297] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:27:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:27:04.560633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779479-18bf-4269-9a1c-ff562e95782b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:04.660311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779479-18bf-4269-9a1c-ff562e95782b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:04.693800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:04.694348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:04.694674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:04.694938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:04.695507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:04.696862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:27:04.705252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:27:04.706382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:27:04.707284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 653/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:27:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:27:04.712282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc3035-d1fc-4214-85b0-026ac0ab7e2d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:04.730414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:27:04.808364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc3035-d1fc-4214-85b0-026ac0ab7e2d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:04.840460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:04.841106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:04.841379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:04.841644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:04.842259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:27:04.842582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:04.843934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:04.848838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 646/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Aug 10 08:27:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:27:04.855655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:04.885946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:27:04.951667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa91f-03c1-4ca9-a464-45d9f6a0b7a8 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:04.985460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9c10e-71f1-44e9-a527-904c88689431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:04.986052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c10e-71f1-44e9-a527-904c88689431 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:04.986328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c10e-71f1-44e9-a527-904c88689431 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:04.986625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9c10e-71f1-44e9-a527-904c88689431 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:04.987319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c10e-71f1-44e9-a527-904c88689431 None admin] RBAC: Adding query filter params (interface=public, service_id=88373311450c40d8b93fa34abf17f95d, region_id=RegionOne) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:27:04.987622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c10e-71f1-44e9-a527-904c88689431 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:04.988967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9c10e-71f1-44e9-a527-904c88689431 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:04.993869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 654/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 10 08:27:04 2022] GET /identity/v3/endpoints?service_id=88373311450c40d8b93fa34abf17f95d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:27:04.999694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:05.079195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:27:05.096895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2970d-9f47-48d2-8ae1-c859a5e8f670 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:05.130289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0975-73cc-4b31-bf91-6ca90497d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:05.130969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0975-73cc-4b31-bf91-6ca90497d217 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:05.135587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0975-73cc-4b31-bf91-6ca90497d217 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:05.135587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0975-73cc-4b31-bf91-6ca90497d217 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:05.135587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d0975-73cc-4b31-bf91-6ca90497d217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:05.135587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d0975-73cc-4b31-bf91-6ca90497d217 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:05.140428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 647/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 10 08:27:04 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:27:07.105857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05feb3-a1e0-4f18-b969-444792d81f19 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:07.106427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05feb3-a1e0-4f18-b969-444792d81f19 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:07.106427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05feb3-a1e0-4f18-b969-444792d81f19 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:07.107800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 655/1302] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:27:07.112849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5bed4-ac09-47cc-a2a7-51241bf57a37 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:07.113276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5bed4-ac09-47cc-a2a7-51241bf57a37 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:07.113416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5bed4-ac09-47cc-a2a7-51241bf57a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:07.131593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f2c5bed4-ac09-47cc-a2a7-51241bf57a37 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:27:07.133356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f2c5bed4-ac09-47cc-a2a7-51241bf57a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:27:07.199447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 648/1303] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:27:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 08:27:07.222080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05feb3-a1e0-4f18-b969-444792d81f19 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:07.315303 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:27:07.322546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05feb3-a1e0-4f18-b969-444792d81f19 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:07.354316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:07.354951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:07.355225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:07.355555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:07.356127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:07.357480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 08:27:07.365830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 08:27:07.367630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application with Lock( Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self._enter() Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application return self.creator() Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application created_value = creator( Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: ERROR keystone.server.flask.application Aug 10 08:27:07.368758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 656/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 10 08:27:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 08:27:07.373916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5bed4-ac09-47cc-a2a7-51241bf57a37 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:07.448863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:27:07.470486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5bed4-ac09-47cc-a2a7-51241bf57a37 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:07.503546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914e6b0-bb6c-40a0-88b8-ffb2dd1ebe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:07.504136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e6b0-bb6c-40a0-88b8-ffb2dd1ebe01 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:07.504408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e6b0-bb6c-40a0-88b8-ffb2dd1ebe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:07.504672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e6b0-bb6c-40a0-88b8-ffb2dd1ebe01 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:07.505337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914e6b0-bb6c-40a0-88b8-ffb2dd1ebe01 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:27:07.505633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914e6b0-bb6c-40a0-88b8-ffb2dd1ebe01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:07.507025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914e6b0-bb6c-40a0-88b8-ffb2dd1ebe01 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:07.511967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 649/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Aug 10 08:27:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:27:07.517765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:27:07.614676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27262d8a-0e00-461b-820f-c0dda5157d45 None admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:27:07.646952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aeb284-4319-42a1-99c0-68d252ade95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:27:07.647535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeb284-4319-42a1-99c0-68d252ade95b None admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:27:07.647812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeb284-4319-42a1-99c0-68d252ade95b None admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:27:07.648149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeb284-4319-42a1-99c0-68d252ade95b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:27:07.648728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aeb284-4319-42a1-99c0-68d252ade95b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:27:07.650075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aeb284-4319-42a1-99c0-68d252ade95b None admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:27:07.730033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 657/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:27:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:27:17.518219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=30 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:27:17.725056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:22.898576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338cf5e-f6b0-4f53-88e9-9cbd873f4c27 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:22.899187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338cf5e-f6b0-4f53-88e9-9cbd873f4c27 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:22.899187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338cf5e-f6b0-4f53-88e9-9cbd873f4c27 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:22.906284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd9663-be6e-42d3-8675-d23f862afefe None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:22.906907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd9663-be6e-42d3-8675-d23f862afefe None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:22.906907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd9663-be6e-42d3-8675-d23f862afefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:22.911832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 650/1307] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:22 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:23.010980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-65cd9663-be6e-42d3-8675-d23f862afefe None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:23.016194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-65cd9663-be6e-42d3-8675-d23f862afefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:23.182456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 658/1308] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:23.247176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cedeb8-6ba5-4f7e-b010-3811a8035c4a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:23.247461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cedeb8-6ba5-4f7e-b010-3811a8035c4a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:23.247807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cedeb8-6ba5-4f7e-b010-3811a8035c4a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:23.249483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 651/1309] 10.222.0.45 () {54 vars in 965 bytes} [Wed Aug 10 08:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:23.256235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5a63-2b70-4dc3-8d23-276b1184ac6e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:23.256945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5a63-2b70-4dc3-8d23-276b1184ac6e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:23.257389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5a63-2b70-4dc3-8d23-276b1184ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:23.454303 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bb6c5a63-2b70-4dc3-8d23-276b1184ac6e None None] MFA Rules not processed for user `80c8c0985f6847368c4f7263b2bf8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:23.455553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bb6c5a63-2b70-4dc3-8d23-276b1184ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:23.499187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:23.606315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 659/1310] 10.222.0.45 () {58 vars in 1062 bytes} [Wed Aug 10 08:33:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:33:23.614989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cedeb8-6ba5-4f7e-b010-3811a8035c4a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:23.616712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-19cedeb8-6ba5-4f7e-b010-3811a8035c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:23.758970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cedeb8-6ba5-4f7e-b010-3811a8035c4a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:23.837896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51c557-1595-4010-bce7-c5a7f05ad0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:23.838798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51c557-1595-4010-bce7-c5a7f05ad0cc service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:23.839262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51c557-1595-4010-bce7-c5a7f05ad0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:23.839683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51c557-1595-4010-bce7-c5a7f05ad0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:23.841438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6d51c557-1595-4010-bce7-c5a7f05ad0cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:23.898900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:23.966050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51c557-1595-4010-bce7-c5a7f05ad0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:23.968413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51c557-1595-4010-bce7-c5a7f05ad0cc service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:24.012392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 652/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:26.336444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b081-c3ab-4d00-8a30-55d1ba484d66 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:26.336968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b081-c3ab-4d00-8a30-55d1ba484d66 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:26.336968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b081-c3ab-4d00-8a30-55d1ba484d66 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:26.338395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 660/1312] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:26.343310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a8d4a-8c96-4d93-9203-23153bef0f65 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:26.343706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a8d4a-8c96-4d93-9203-23153bef0f65 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:26.343921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a8d4a-8c96-4d93-9203-23153bef0f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:26.414352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dc0a8d4a-8c96-4d93-9203-23153bef0f65 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:26.415578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dc0a8d4a-8c96-4d93-9203-23153bef0f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:26.524628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 653/1313] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:26.564177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6b081-c3ab-4d00-8a30-55d1ba484d66 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:26.565778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d2d6b081-c3ab-4d00-8a30-55d1ba484d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:26.669099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6b081-c3ab-4d00-8a30-55d1ba484d66 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:26.740539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:26.743424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137c10a-69a3-44ec-afd1-c804e434b5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:26.744185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c10a-69a3-44ec-afd1-c804e434b5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:26.744462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c10a-69a3-44ec-afd1-c804e434b5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:26.744724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c10a-69a3-44ec-afd1-c804e434b5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:26.746389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a137c10a-69a3-44ec-afd1-c804e434b5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:26.858062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137c10a-69a3-44ec-afd1-c804e434b5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:26.859544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137c10a-69a3-44ec-afd1-c804e434b5c0 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:26.878071 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 661/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:29.321437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8832-e60c-4e8c-83e0-932e68fc23d1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:29.321979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8832-e60c-4e8c-83e0-932e68fc23d1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:29.322073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8832-e60c-4e8c-83e0-932e68fc23d1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:29.323480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 654/1315] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:29.328469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46453000-9600-4432-990f-ae604acc3183 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:29.328910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46453000-9600-4432-990f-ae604acc3183 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:29.329008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46453000-9600-4432-990f-ae604acc3183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:29.392966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-46453000-9600-4432-990f-ae604acc3183 None None] MFA Rules not processed for user `1c8a150ece2241cb8d50235feaf78b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:29.394153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-46453000-9600-4432-990f-ae604acc3183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:29.446337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:29.492995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 662/1316] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:29.533240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8832-e60c-4e8c-83e0-932e68fc23d1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:29.534875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-af8f8832-e60c-4e8c-83e0-932e68fc23d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:29.544693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:29.756263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8832-e60c-4e8c-83e0-932e68fc23d1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:29.828654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88002a-b33d-47a8-a56a-015b8b833127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:29.829243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88002a-b33d-47a8-a56a-015b8b833127 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:29.829512 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88002a-b33d-47a8-a56a-015b8b833127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:29.829774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88002a-b33d-47a8-a56a-015b8b833127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:29.831384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9b88002a-b33d-47a8-a56a-015b8b833127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:29.890865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:29.937210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88002a-b33d-47a8-a56a-015b8b833127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:29.938731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88002a-b33d-47a8-a56a-015b8b833127 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:29.956962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 655/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:33:32.765905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c98e-2b7d-4ed1-af5f-d7ce38837890 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:32.766506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c98e-2b7d-4ed1-af5f-d7ce38837890 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:32.766506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c98e-2b7d-4ed1-af5f-d7ce38837890 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:32.767836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 663/1318] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:32.772847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00763964-befc-44c7-ae4d-abc3744a0bb8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:32.773265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00763964-befc-44c7-ae4d-abc3744a0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:32.773374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00763964-befc-44c7-ae4d-abc3744a0bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:32.837635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-00763964-befc-44c7-ae4d-abc3744a0bb8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:32.838856 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-00763964-befc-44c7-ae4d-abc3744a0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:32.933659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 656/1319] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:32.972678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c98e-2b7d-4ed1-af5f-d7ce38837890 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:32.974209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9f16c98e-2b7d-4ed1-af5f-d7ce38837890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:33.075491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c98e-2b7d-4ed1-af5f-d7ce38837890 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:33.146504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd685bd-3c86-4aa4-954a-0b4cec419e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:33.147099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd685bd-3c86-4aa4-954a-0b4cec419e0b service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:33.147374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd685bd-3c86-4aa4-954a-0b4cec419e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:33.147642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd685bd-3c86-4aa4-954a-0b4cec419e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:33.149263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ffd685bd-3c86-4aa4-954a-0b4cec419e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:33.156552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:33.255481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd685bd-3c86-4aa4-954a-0b4cec419e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:33.256931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd685bd-3c86-4aa4-954a-0b4cec419e0b service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:33.275308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 664/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:36.280157 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabde12-89e8-4849-888b-1bf02d905e9b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:36.280712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabde12-89e8-4849-888b-1bf02d905e9b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:36.280712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabde12-89e8-4849-888b-1bf02d905e9b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:36.281989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 657/1321] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:36.287066 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16f4d-bb20-4252-ba20-909bc60b67df None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:36.287474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16f4d-bb20-4252-ba20-909bc60b67df None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:36.287604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16f4d-bb20-4252-ba20-909bc60b67df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:36.352590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-74b16f4d-bb20-4252-ba20-909bc60b67df None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:36.353779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-74b16f4d-bb20-4252-ba20-909bc60b67df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:36.412215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:36.450090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 665/1322] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:36.487459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabde12-89e8-4849-888b-1bf02d905e9b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:36.489286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ecabde12-89e8-4849-888b-1bf02d905e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:36.510806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:36.600694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabde12-89e8-4849-888b-1bf02d905e9b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:36.675584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f2b0-4427-495d-b9c4-fcdb2ab54c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:36.676186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f2b0-4427-495d-b9c4-fcdb2ab54c9e service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:36.676457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f2b0-4427-495d-b9c4-fcdb2ab54c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:36.676723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f2b0-4427-495d-b9c4-fcdb2ab54c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:36.678627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4bf6f2b0-4427-495d-b9c4-fcdb2ab54c9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:36.748147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:36.786851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f2b0-4427-495d-b9c4-fcdb2ab54c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:36.788278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f2b0-4427-495d-b9c4-fcdb2ab54c9e service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:36.806442 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 658/1323] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:38.840834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e801-dc06-4a30-99bf-57e7cdec1a62 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:38.841372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e801-dc06-4a30-99bf-57e7cdec1a62 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:38.841372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e801-dc06-4a30-99bf-57e7cdec1a62 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:38.842920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 666/1324] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:38.847953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaed45-eb33-4b37-99f7-534a884da0cb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:38.848361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaed45-eb33-4b37-99f7-534a884da0cb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:38.848602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaed45-eb33-4b37-99f7-534a884da0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:38.913499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e6aaed45-eb33-4b37-99f7-534a884da0cb None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:38.914722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e6aaed45-eb33-4b37-99f7-534a884da0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:39.013424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 659/1325] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:39.050027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e801-dc06-4a30-99bf-57e7cdec1a62 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:39.051636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d3c5e801-dc06-4a30-99bf-57e7cdec1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:39.157088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e801-dc06-4a30-99bf-57e7cdec1a62 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:39.230243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7167b-8cb1-4d3d-b82a-c9d7d48e5d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:39.230783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7167b-8cb1-4d3d-b82a-c9d7d48e5d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:39.231057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7167b-8cb1-4d3d-b82a-c9d7d48e5d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:39.231342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7167b-8cb1-4d3d-b82a-c9d7d48e5d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:39.232910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e2b7167b-8cb1-4d3d-b82a-c9d7d48e5d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:39.249827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:39.345486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7167b-8cb1-4d3d-b82a-c9d7d48e5d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:39.346993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7167b-8cb1-4d3d-b82a-c9d7d48e5d4f service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:39.367584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 667/1326] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:41.419630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d3b5-c9c0-4339-bd0e-4beb6b9220c0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:41.420145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d3b5-c9c0-4339-bd0e-4beb6b9220c0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:41.420237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d3b5-c9c0-4339-bd0e-4beb6b9220c0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:41.421737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 660/1327] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:41.426744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0cb4-5943-4b32-8a36-dff658cc64eb None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:41.427192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0cb4-5943-4b32-8a36-dff658cc64eb None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:41.427416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0cb4-5943-4b32-8a36-dff658cc64eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:41.499960 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-e29c0cb4-5943-4b32-8a36-dff658cc64eb None None] MFA Rules not processed for user `1c8a150ece2241cb8d50235feaf78b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:41.501172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e29c0cb4-5943-4b32-8a36-dff658cc64eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:41.567287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:41.599880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 668/1328] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:41.649762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89a1e9-55d3-4343-8c85-1a5dc1d424a1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:41.649953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89a1e9-55d3-4343-8c85-1a5dc1d424a1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:41.650223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89a1e9-55d3-4343-8c85-1a5dc1d424a1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:41.651628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 661/1329] 10.222.0.45 () {54 vars in 965 bytes} [Wed Aug 10 08:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:41.658397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb739e76-f399-48bf-97f4-6a33a50034a8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:41.658715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb739e76-f399-48bf-97f4-6a33a50034a8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:41.658988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb739e76-f399-48bf-97f4-6a33a50034a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:41.735894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-eb739e76-f399-48bf-97f4-6a33a50034a8 None None] MFA Rules not processed for user `80c8c0985f6847368c4f7263b2bf8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:41.737132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-eb739e76-f399-48bf-97f4-6a33a50034a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:41.816578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 669/1330] 10.222.0.45 () {58 vars in 1062 bytes} [Wed Aug 10 08:33:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:41.825341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89a1e9-55d3-4343-8c85-1a5dc1d424a1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:41.827457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb89a1e9-55d3-4343-8c85-1a5dc1d424a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:41.859508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:41.932433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89a1e9-55d3-4343-8c85-1a5dc1d424a1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:42.008051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232aac8-3f75-446d-bc44-71e2b0901282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:42.008649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232aac8-3f75-446d-bc44-71e2b0901282 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:42.008921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232aac8-3f75-446d-bc44-71e2b0901282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:42.009185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232aac8-3f75-446d-bc44-71e2b0901282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:42.010812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7232aac8-3f75-446d-bc44-71e2b0901282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:42.086538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:42.117427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232aac8-3f75-446d-bc44-71e2b0901282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:42.118902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232aac8-3f75-446d-bc44-71e2b0901282 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:42.147991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 662/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:44.971604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8083-5f26-4188-9563-d69da66cbb1a None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:44.972083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8083-5f26-4188-9563-d69da66cbb1a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:44.972192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8083-5f26-4188-9563-d69da66cbb1a None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:44.973572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 670/1332] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:44.979524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d291c-0826-4d20-bd17-6d9ae6636a33 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:44.979970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d291c-0826-4d20-bd17-6d9ae6636a33 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:44.984372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d291c-0826-4d20-bd17-6d9ae6636a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:45.048046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bf8d291c-0826-4d20-bd17-6d9ae6636a33 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:45.049260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf8d291c-0826-4d20-bd17-6d9ae6636a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:45.144204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 663/1333] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:33:45.182488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8083-5f26-4188-9563-d69da66cbb1a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:45.184030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5e5a8083-5f26-4188-9563-d69da66cbb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:45.253865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:45.287758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8083-5f26-4188-9563-d69da66cbb1a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:45.360027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ffd97-8c14-4441-a9f9-a8153887e782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:45.360629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ffd97-8c14-4441-a9f9-a8153887e782 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:45.360913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ffd97-8c14-4441-a9f9-a8153887e782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:45.361185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ffd97-8c14-4441-a9f9-a8153887e782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:45.362815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c88ffd97-8c14-4441-a9f9-a8153887e782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:45.470105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ffd97-8c14-4441-a9f9-a8153887e782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:45.471573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ffd97-8c14-4441-a9f9-a8153887e782 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:45.481363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:45.490851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 671/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:47.520250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd91e-ff1c-4313-9774-4084e1a70089 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:47.520834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd91e-ff1c-4313-9774-4084e1a70089 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:47.520834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd91e-ff1c-4313-9774-4084e1a70089 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:47.522154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 664/1335] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:47.527340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a4ee8-d118-49a6-8869-0987d0621fe4 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:47.527724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a4ee8-d118-49a6-8869-0987d0621fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:47.527881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a4ee8-d118-49a6-8869-0987d0621fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:47.591830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-788a4ee8-d118-49a6-8869-0987d0621fe4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:47.593618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-788a4ee8-d118-49a6-8869-0987d0621fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:47.685067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 672/1336] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:47.725743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dd91e-ff1c-4313-9774-4084e1a70089 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:47.727273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7e2dd91e-ff1c-4313-9774-4084e1a70089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:47.766345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:47.830020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dd91e-ff1c-4313-9774-4084e1a70089 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:47.901824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a54148-1a3c-4dbe-941f-68a1ae2e6013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:47.902444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54148-1a3c-4dbe-941f-68a1ae2e6013 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:47.902749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54148-1a3c-4dbe-941f-68a1ae2e6013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:47.903017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54148-1a3c-4dbe-941f-68a1ae2e6013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:47.904599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-49a54148-1a3c-4dbe-941f-68a1ae2e6013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:47.985493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:48.010404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a54148-1a3c-4dbe-941f-68a1ae2e6013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:48.012602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a54148-1a3c-4dbe-941f-68a1ae2e6013 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:48.031340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 665/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:50.593002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5d03-8be7-4cd1-9e6b-a852a35f2e15 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:50.593513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5d03-8be7-4cd1-9e6b-a852a35f2e15 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:50.593513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd5d03-8be7-4cd1-9e6b-a852a35f2e15 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:50.594859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 673/1338] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:50.599839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519525-bd97-4fbb-ac2a-dfe11bef8099 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:50.600234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519525-bd97-4fbb-ac2a-dfe11bef8099 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:50.600389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519525-bd97-4fbb-ac2a-dfe11bef8099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:50.664331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-84519525-bd97-4fbb-ac2a-dfe11bef8099 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:50.665519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-84519525-bd97-4fbb-ac2a-dfe11bef8099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:50.758520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 666/1339] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:50.794560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5d03-8be7-4cd1-9e6b-a852a35f2e15 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:50.796142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-49bd5d03-8be7-4cd1-9e6b-a852a35f2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:50.871577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:50.899188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd5d03-8be7-4cd1-9e6b-a852a35f2e15 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:50.979057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94ccd8-9d88-4f58-97ad-11679241f505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:50.979661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94ccd8-9d88-4f58-97ad-11679241f505 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:50.979935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94ccd8-9d88-4f58-97ad-11679241f505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:50.980199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94ccd8-9d88-4f58-97ad-11679241f505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:50.981776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3d94ccd8-9d88-4f58-97ad-11679241f505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:51.087464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94ccd8-9d88-4f58-97ad-11679241f505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:51.088889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94ccd8-9d88-4f58-97ad-11679241f505 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:51.106940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 674/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:55.329676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c58c3-886e-437f-b3bb-f71a57b8cc3d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:55.330273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c58c3-886e-437f-b3bb-f71a57b8cc3d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:55.330273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c58c3-886e-437f-b3bb-f71a57b8cc3d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:55.331612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 667/1341] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:55.336678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f113ac-288b-4fba-8eff-7a920b5232b8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:55.337103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f113ac-288b-4fba-8eff-7a920b5232b8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:55.337228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f113ac-288b-4fba-8eff-7a920b5232b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:55.343857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:55.406274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-30f113ac-288b-4fba-8eff-7a920b5232b8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:55.407641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-30f113ac-288b-4fba-8eff-7a920b5232b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:55.504360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 675/1342] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:55.543361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c58c3-886e-437f-b3bb-f71a57b8cc3d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:55.544964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2b0c58c3-886e-437f-b3bb-f71a57b8cc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:55.594710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:55.650176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c58c3-886e-437f-b3bb-f71a57b8cc3d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:55.727043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94648655-d494-49cc-9fc9-ca8e085aa59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:55.727656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648655-d494-49cc-9fc9-ca8e085aa59e service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:55.727932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648655-d494-49cc-9fc9-ca8e085aa59e service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:55.728201 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648655-d494-49cc-9fc9-ca8e085aa59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:55.729794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-94648655-d494-49cc-9fc9-ca8e085aa59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:55.821886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:55.838510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94648655-d494-49cc-9fc9-ca8e085aa59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:55.839977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94648655-d494-49cc-9fc9-ca8e085aa59e service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:55.858206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 668/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:33:58.883838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf45e0f-cbc2-46a8-9fed-0f683961358d None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:58.884343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf45e0f-cbc2-46a8-9fed-0f683961358d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:58.884343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf45e0f-cbc2-46a8-9fed-0f683961358d None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:58.885622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 676/1344] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:33:58.890922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b599b-cda1-4417-9dbd-5fef0e481c89 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:58.891338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b599b-cda1-4417-9dbd-5fef0e481c89 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:58.891488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b599b-cda1-4417-9dbd-5fef0e481c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:58.963251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-234b599b-cda1-4417-9dbd-5fef0e481c89 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:33:58.964450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-234b599b-cda1-4417-9dbd-5fef0e481c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:59.059321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 669/1345] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:33:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:33:59.096300 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf45e0f-cbc2-46a8-9fed-0f683961358d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:33:59.097821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8cf45e0f-cbc2-46a8-9fed-0f683961358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:59.185970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:33:59.202733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf45e0f-cbc2-46a8-9fed-0f683961358d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:33:59.278700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1a30c-fc80-46f2-a955-6b35015143cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:33:59.279920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1a30c-fc80-46f2-a955-6b35015143cf service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:33:59.280222 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1a30c-fc80-46f2-a955-6b35015143cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:33:59.280485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1a30c-fc80-46f2-a955-6b35015143cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:33:59.282230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-40f1a30c-fc80-46f2-a955-6b35015143cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:33:59.397545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1a30c-fc80-46f2-a955-6b35015143cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:33:59.399000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1a30c-fc80-46f2-a955-6b35015143cf service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:33:59.417959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 677/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:33:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:03.639351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bedf8-be03-4590-ba63-20948554cbc9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:03.639942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bedf8-be03-4590-ba63-20948554cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:03.639942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bedf8-be03-4590-ba63-20948554cbc9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:03.641393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 670/1347] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:03.646872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ba90-fad7-4481-8710-1a664adb6ad6 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:03.647371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ba90-fad7-4481-8710-1a664adb6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:03.647480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ba90-fad7-4481-8710-1a664adb6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:03.665767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:03.719602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-e2e5ba90-fad7-4481-8710-1a664adb6ad6 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:03.721638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e2e5ba90-fad7-4481-8710-1a664adb6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:03.821331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 678/1348] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:03.859168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bedf8-be03-4590-ba63-20948554cbc9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:03.860774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-576bedf8-be03-4590-ba63-20948554cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:03.921699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:03.974542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bedf8-be03-4590-ba63-20948554cbc9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:04.051744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc05e-5604-488c-aa9b-f6b46d056a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:04.052608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc05e-5604-488c-aa9b-f6b46d056a3d service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:04.052887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc05e-5604-488c-aa9b-f6b46d056a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:04.053155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc05e-5604-488c-aa9b-f6b46d056a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:04.054848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8d5fc05e-5604-488c-aa9b-f6b46d056a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:04.161497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:04.164612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc05e-5604-488c-aa9b-f6b46d056a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:04.166050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc05e-5604-488c-aa9b-f6b46d056a3d service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:04.184384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 671/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:09.068826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2fc16-67e7-4d46-a697-d732abc9ac29 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:09.069374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2fc16-67e7-4d46-a697-d732abc9ac29 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:09.069374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2fc16-67e7-4d46-a697-d732abc9ac29 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:09.070725 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 679/1350] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:34:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:09.075794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32224-bb5b-4396-9fcb-2f251adbb567 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:09.076889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32224-bb5b-4396-9fcb-2f251adbb567 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:09.077278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32224-bb5b-4396-9fcb-2f251adbb567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:09.196602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-07c32224-bb5b-4396-9fcb-2f251adbb567 None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:09.197787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-07c32224-bb5b-4396-9fcb-2f251adbb567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:09.312772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 672/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:34:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:13.425230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf51b-078f-46ff-a124-01e21912d723 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:13.425763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf51b-078f-46ff-a124-01e21912d723 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:13.425763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf51b-078f-46ff-a124-01e21912d723 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:13.427540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 680/1352] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:13.432818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238781d-e5bd-4294-a099-78f5f4eb6c09 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:13.433257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238781d-e5bd-4294-a099-78f5f4eb6c09 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:13.433349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238781d-e5bd-4294-a099-78f5f4eb6c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:13.491719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:13.515670 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b238781d-e5bd-4294-a099-78f5f4eb6c09 None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:13.516874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b238781d-e5bd-4294-a099-78f5f4eb6c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:13.630515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 673/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:34:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:13.819223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=59 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:14.942073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a240-efdf-439c-b341-224868e3c1a3 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:14.942743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a240-efdf-439c-b341-224868e3c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:14.943005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a240-efdf-439c-b341-224868e3c1a3 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:14.944573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 681/1354] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:14.949965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13f59f-96b3-4584-a1d0-f2027cd1af9c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:14.950568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13f59f-96b3-4584-a1d0-f2027cd1af9c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:14.950707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13f59f-96b3-4584-a1d0-f2027cd1af9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:15.028155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0a13f59f-96b3-4584-a1d0-f2027cd1af9c None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:15.029882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0a13f59f-96b3-4584-a1d0-f2027cd1af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:15.071510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:15.135832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 674/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:34:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:18.598870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998131-e4b6-431c-b069-93f4e0767b22 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:18.599395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998131-e4b6-431c-b069-93f4e0767b22 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:18.599647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998131-e4b6-431c-b069-93f4e0767b22 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:18.601644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 682/1356] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:18.607877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1da2-7462-4b1a-a3b6-84023e353c2d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:18.608697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1da2-7462-4b1a-a3b6-84023e353c2d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:18.608970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1da2-7462-4b1a-a3b6-84023e353c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:18.689483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e91b1da2-7462-4b1a-a3b6-84023e353c2d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:18.691118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e91b1da2-7462-4b1a-a3b6-84023e353c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:18.798736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 675/1357] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:18.855674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901afe-2230-4943-8f02-671750e14fb0 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:18.857910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901afe-2230-4943-8f02-671750e14fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:18.858751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901afe-2230-4943-8f02-671750e14fb0 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:18.862124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 683/1358] 10.222.0.45 () {54 vars in 962 bytes} [Wed Aug 10 08:34:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:18.868250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a871e-0f44-43da-b98e-da5ad88b3542 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:18.868845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a871e-0f44-43da-b98e-da5ad88b3542 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:18.869388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a871e-0f44-43da-b98e-da5ad88b3542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:18.887574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:18.959815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-726a871e-0f44-43da-b98e-da5ad88b3542 None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:18.961369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-726a871e-0f44-43da-b98e-da5ad88b3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:19.086620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 676/1359] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Aug 10 08:34:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:34:19.096365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6901afe-2230-4943-8f02-671750e14fb0 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:19.097999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c6901afe-2230-4943-8f02-671750e14fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:19.250164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6901afe-2230-4943-8f02-671750e14fb0 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:19.352141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:19.395097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8ca76-bfa3-4541-959a-ac95a2c5774c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:19.395701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ca76-bfa3-4541-959a-ac95a2c5774c service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:19.395973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ca76-bfa3-4541-959a-ac95a2c5774c service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:19.396237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ca76-bfa3-4541-959a-ac95a2c5774c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:19.397822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-dfd8ca76-bfa3-4541-959a-ac95a2c5774c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:19.493521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8ca76-bfa3-4541-959a-ac95a2c5774c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:19.495152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8ca76-bfa3-4541-959a-ac95a2c5774c service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:19.514095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 684/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:21.734733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09d3cf-859b-4f47-964f-702d379d5adb None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:21.735257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09d3cf-859b-4f47-964f-702d379d5adb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:21.735257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09d3cf-859b-4f47-964f-702d379d5adb None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:21.736675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 677/1361] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:21.741922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9437ec-b64e-4f97-a59f-065962c447a2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:21.742349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9437ec-b64e-4f97-a59f-065962c447a2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:21.742452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9437ec-b64e-4f97-a59f-065962c447a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:21.817856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bb9437ec-b64e-4f97-a59f-065962c447a2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:21.819006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bb9437ec-b64e-4f97-a59f-065962c447a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:21.860580 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:21.930517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 685/1362] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:21.967042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09d3cf-859b-4f47-964f-702d379d5adb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:21.968650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aa09d3cf-859b-4f47-964f-702d379d5adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:22.043771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:22.143014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09d3cf-859b-4f47-964f-702d379d5adb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:22.266649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d0c5-7b60-4203-a605-79319d523e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:22.267254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d0c5-7b60-4203-a605-79319d523e83 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:22.267524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d0c5-7b60-4203-a605-79319d523e83 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:22.267800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d0c5-7b60-4203-a605-79319d523e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:22.269367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7f57d0c5-7b60-4203-a605-79319d523e83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:22.296136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:22.371589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57d0c5-7b60-4203-a605-79319d523e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:22.373759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57d0c5-7b60-4203-a605-79319d523e83 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:22.392584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 678/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:24.827517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7b3ca-170a-4fd3-a2b0-72398cdf2b90 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:24.828031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7b3ca-170a-4fd3-a2b0-72398cdf2b90 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:24.828031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7b3ca-170a-4fd3-a2b0-72398cdf2b90 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:24.829356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 686/1364] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:24.834617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45305f-d560-4d1d-9aef-d6a63e8d1fe9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:24.835380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45305f-d560-4d1d-9aef-d6a63e8d1fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:24.835660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45305f-d560-4d1d-9aef-d6a63e8d1fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:24.933519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-de45305f-d560-4d1d-9aef-d6a63e8d1fe9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:24.935534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-de45305f-d560-4d1d-9aef-d6a63e8d1fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:25.043563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:25.050642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 679/1365] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:25.096350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286aec4-6484-45ab-b615-cfd146ff20fa None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:25.096644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286aec4-6484-45ab-b615-cfd146ff20fa None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:25.097362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286aec4-6484-45ab-b615-cfd146ff20fa None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:25.098760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 687/1366] 10.222.0.45 () {54 vars in 962 bytes} [Wed Aug 10 08:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:25.104416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be810-75d6-4d83-9ff0-ba98c5a2ac8d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:25.105061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be810-75d6-4d83-9ff0-ba98c5a2ac8d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:25.105061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be810-75d6-4d83-9ff0-ba98c5a2ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:25.188940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d78be810-75d6-4d83-9ff0-ba98c5a2ac8d None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:25.195099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d78be810-75d6-4d83-9ff0-ba98c5a2ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:25.322960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 680/1367] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Aug 10 08:34:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:25.331023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286aec4-6484-45ab-b615-cfd146ff20fa None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:25.332863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2286aec4-6484-45ab-b615-cfd146ff20fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:25.496547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286aec4-6484-45ab-b615-cfd146ff20fa None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:25.518168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:25.619225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c8d30-7e70-42f1-88a9-259cb33293b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:25.619741 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c8d30-7e70-42f1-88a9-259cb33293b0 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:25.620015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c8d30-7e70-42f1-88a9-259cb33293b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:25.620280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c8d30-7e70-42f1-88a9-259cb33293b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:25.621861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-978c8d30-7e70-42f1-88a9-259cb33293b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:25.718509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c8d30-7e70-42f1-88a9-259cb33293b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:25.719987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c8d30-7e70-42f1-88a9-259cb33293b0 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:25.738937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 688/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:26.845746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f964c-20ef-4996-9814-9842d5c81671 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:26.846294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f964c-20ef-4996-9814-9842d5c81671 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:26.846294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f964c-20ef-4996-9814-9842d5c81671 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:26.848250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 681/1369] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:26.853146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc2a4-cb06-42e7-9d05-c3103c68e822 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:26.853911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc2a4-cb06-42e7-9d05-c3103c68e822 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:26.854369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc2a4-cb06-42e7-9d05-c3103c68e822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:26.888330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:26.930554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-707bc2a4-cb06-42e7-9d05-c3103c68e822 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:26.931760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-707bc2a4-cb06-42e7-9d05-c3103c68e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:27.045700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 689/1370] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:34:27.399192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c110bf-6827-46d9-974b-a99c79b01679 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:27.399473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c110bf-6827-46d9-974b-a99c79b01679 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:27.399746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c110bf-6827-46d9-974b-a99c79b01679 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:27.401261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 682/1371] 10.222.0.45 () {54 vars in 964 bytes} [Wed Aug 10 08:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:27.406651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd4672-e7a4-4dc6-865b-ccd7c4ea02b2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:27.407039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd4672-e7a4-4dc6-865b-ccd7c4ea02b2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:27.407405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd4672-e7a4-4dc6-865b-ccd7c4ea02b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:27.486901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-83bd4672-e7a4-4dc6-865b-ccd7c4ea02b2 None None] MFA Rules not processed for user `44743b0d10ae4b54920c821e1ef587b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:27.488254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-83bd4672-e7a4-4dc6-865b-ccd7c4ea02b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:27.537488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:27.575447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 690/1372] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Aug 10 08:34:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:27.584214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c110bf-6827-46d9-974b-a99c79b01679 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:27.585723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d0c110bf-6827-46d9-974b-a99c79b01679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:27.646529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:27.703691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c110bf-6827-46d9-974b-a99c79b01679 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:27.780276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a68b2b-6371-42cc-a988-bd5a527c4d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:27.780886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b2b-6371-42cc-a988-bd5a527c4d6d service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:27.781239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b2b-6371-42cc-a988-bd5a527c4d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:27.781523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b2b-6371-42cc-a988-bd5a527c4d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:27.783356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-73a68b2b-6371-42cc-a988-bd5a527c4d6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:27.885839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:27.899946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a68b2b-6371-42cc-a988-bd5a527c4d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:27.901926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a68b2b-6371-42cc-a988-bd5a527c4d6d service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:27.921216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 683/1373] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:27.977879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c613-0351-44a5-89db-4d48664381c8 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:27.978284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c613-0351-44a5-89db-4d48664381c8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:27.978643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c613-0351-44a5-89db-4d48664381c8 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:27.979928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 691/1374] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:27.986002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c628-5a6b-4192-ac03-d4008dba8657 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:27.986396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c628-5a6b-4192-ac03-d4008dba8657 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:27.986735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c628-5a6b-4192-ac03-d4008dba8657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:28.065064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9be4c628-5a6b-4192-ac03-d4008dba8657 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:28.066546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9be4c628-5a6b-4192-ac03-d4008dba8657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:28.169862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 684/1375] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:28.213976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1c613-0351-44a5-89db-4d48664381c8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:28.215587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-37a1c613-0351-44a5-89db-4d48664381c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:28.379892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1c613-0351-44a5-89db-4d48664381c8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:28.430956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:28.492026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d4e7-463f-49d0-b291-c7a9a92ba059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:28.492625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d4e7-463f-49d0-b291-c7a9a92ba059 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:28.492901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d4e7-463f-49d0-b291-c7a9a92ba059 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:28.493170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d4e7-463f-49d0-b291-c7a9a92ba059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:28.494828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-61a5d4e7-463f-49d0-b291-c7a9a92ba059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:28.591353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5d4e7-463f-49d0-b291-c7a9a92ba059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:28.592941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5d4e7-463f-49d0-b291-c7a9a92ba059 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:28.611365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 692/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:30.766299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4936724-1239-41f8-86c8-8a37f5e58926 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:30.766881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4936724-1239-41f8-86c8-8a37f5e58926 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:30.766881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4936724-1239-41f8-86c8-8a37f5e58926 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:30.768223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 685/1377] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:30.773308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe021-5be9-45a7-a07d-6b5efbacc949 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:30.773758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe021-5be9-45a7-a07d-6b5efbacc949 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:30.773856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe021-5be9-45a7-a07d-6b5efbacc949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:30.839453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ac4fe021-5be9-45a7-a07d-6b5efbacc949 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:30.840673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ac4fe021-5be9-45a7-a07d-6b5efbacc949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:30.847342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:30.944702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 693/1378] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:30.988437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4936724-1239-41f8-86c8-8a37f5e58926 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:30.990790 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e4936724-1239-41f8-86c8-8a37f5e58926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:31.087460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:31.210709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4936724-1239-41f8-86c8-8a37f5e58926 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:31.289200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42304e-6a29-49d5-a2f9-b8287ef965ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:31.289692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42304e-6a29-49d5-a2f9-b8287ef965ea service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:31.289966 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42304e-6a29-49d5-a2f9-b8287ef965ea service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:31.290230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42304e-6a29-49d5-a2f9-b8287ef965ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:31.291842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9d42304e-6a29-49d5-a2f9-b8287ef965ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:31.319340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:31.398756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42304e-6a29-49d5-a2f9-b8287ef965ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:31.400449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42304e-6a29-49d5-a2f9-b8287ef965ea service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:31.425563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 686/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:33.615404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e261d8-17a7-468a-8c31-a17ee502b313 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:33.615999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e261d8-17a7-468a-8c31-a17ee502b313 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:33.615999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e261d8-17a7-468a-8c31-a17ee502b313 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:33.617433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 694/1380] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:33.623295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51175d60-c1c7-42ad-834a-9e8830436dc8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:33.623792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51175d60-c1c7-42ad-834a-9e8830436dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:33.623892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51175d60-c1c7-42ad-834a-9e8830436dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:33.692130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-51175d60-c1c7-42ad-834a-9e8830436dc8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:33.693312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-51175d60-c1c7-42ad-834a-9e8830436dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:33.787245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:33.794182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 687/1381] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:33.838854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e261d8-17a7-468a-8c31-a17ee502b313 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:33.839845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-04e261d8-17a7-468a-8c31-a17ee502b313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:33.987563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:33.998859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e261d8-17a7-468a-8c31-a17ee502b313 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:34.117449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd82eb-01a2-415b-97db-39263bd66896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:34.118046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd82eb-01a2-415b-97db-39263bd66896 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:34.118315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd82eb-01a2-415b-97db-39263bd66896 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:34.118604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd82eb-01a2-415b-97db-39263bd66896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:34.120189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5edd82eb-01a2-415b-97db-39263bd66896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:34.213215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd82eb-01a2-415b-97db-39263bd66896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:34.214763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd82eb-01a2-415b-97db-39263bd66896 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:34.226237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:34.235491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 695/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:36.441685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5648a-e31b-4750-ac9d-46909be86c78 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:36.442351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5648a-e31b-4750-ac9d-46909be86c78 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:36.442351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5648a-e31b-4750-ac9d-46909be86c78 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:36.443575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 688/1383] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:36.448751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f7b3-4d83-4fb7-aaf5-addfc70261da None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:36.449224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f7b3-4d83-4fb7-aaf5-addfc70261da None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:36.449425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f7b3-4d83-4fb7-aaf5-addfc70261da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:36.518162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-6350f7b3-4d83-4fb7-aaf5-addfc70261da None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:36.519535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6350f7b3-4d83-4fb7-aaf5-addfc70261da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:36.635633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 696/1384] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:36.678934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5648a-e31b-4750-ac9d-46909be86c78 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:36.680477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c8f5648a-e31b-4750-ac9d-46909be86c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:36.828963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5648a-e31b-4750-ac9d-46909be86c78 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:36.900212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:36.949023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408d0e6-0477-4a44-ab68-27bbea64e5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:36.950195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d0e6-0477-4a44-ab68-27bbea64e5a5 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:36.950601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d0e6-0477-4a44-ab68-27bbea64e5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:36.950847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d0e6-0477-4a44-ab68-27bbea64e5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:36.953245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d408d0e6-0477-4a44-ab68-27bbea64e5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:37.044965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408d0e6-0477-4a44-ab68-27bbea64e5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:37.046581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408d0e6-0477-4a44-ab68-27bbea64e5a5 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:37.065443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 689/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:39.136789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021180-30bc-436b-b6ee-2c2577b647db None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:39.137929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021180-30bc-436b-b6ee-2c2577b647db None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:39.137929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021180-30bc-436b-b6ee-2c2577b647db None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:39.139240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 697/1386] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:39.144668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475763-78e1-422c-80d6-2608c6349239 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:39.145102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475763-78e1-422c-80d6-2608c6349239 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:39.145214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475763-78e1-422c-80d6-2608c6349239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:39.213984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-76475763-78e1-422c-80d6-2608c6349239 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:39.215539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-76475763-78e1-422c-80d6-2608c6349239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:39.249573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:39.323584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 690/1387] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:34:39.368866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021180-30bc-436b-b6ee-2c2577b647db None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:39.370583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ea021180-30bc-436b-b6ee-2c2577b647db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:39.449903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:39.523560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021180-30bc-436b-b6ee-2c2577b647db None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:39.647622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c0021-895d-4192-a823-87262aacdd74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:39.648219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0021-895d-4192-a823-87262aacdd74 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:39.648493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0021-895d-4192-a823-87262aacdd74 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:39.649038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0021-895d-4192-a823-87262aacdd74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:39.650709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c88c0021-895d-4192-a823-87262aacdd74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:39.688538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:39.740412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c0021-895d-4192-a823-87262aacdd74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:39.742055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c0021-895d-4192-a823-87262aacdd74 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:39.760513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 698/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:41.866577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e879-e9ad-4030-a3b7-644408505874 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:41.867152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e879-e9ad-4030-a3b7-644408505874 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:41.867152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e879-e9ad-4030-a3b7-644408505874 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:41.868466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 691/1389] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:41.874106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876570e0-e74e-47aa-8816-52701dd243a9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:41.874601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876570e0-e74e-47aa-8816-52701dd243a9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:41.874809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876570e0-e74e-47aa-8816-52701dd243a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:41.945476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-876570e0-e74e-47aa-8816-52701dd243a9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:41.946704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-876570e0-e74e-47aa-8816-52701dd243a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:42.041614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 699/1390] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:34:42.086966 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2e879-e9ad-4030-a3b7-644408505874 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:42.088546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-71b2e879-e9ad-4030-a3b7-644408505874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:42.233114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2e879-e9ad-4030-a3b7-644408505874 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:42.250211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:42.348321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a4d23-07ad-4978-ba7f-a1175f938d90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:42.348940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a4d23-07ad-4978-ba7f-a1175f938d90 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:42.349194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a4d23-07ad-4978-ba7f-a1175f938d90 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:42.349455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a4d23-07ad-4978-ba7f-a1175f938d90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:42.351059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-543a4d23-07ad-4978-ba7f-a1175f938d90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:42.438965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a4d23-07ad-4978-ba7f-a1175f938d90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:42.440602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a4d23-07ad-4978-ba7f-a1175f938d90 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:42.459364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 692/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:43.186913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae94d4-07ed-4e40-8107-c6c486040724 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:43.187435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae94d4-07ed-4e40-8107-c6c486040724 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:43.191751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae94d4-07ed-4e40-8107-c6c486040724 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:43.191751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 700/1392] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:43.193761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9274d-c788-448b-9072-aa0a51c27c3a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:43.194147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9274d-c788-448b-9072-aa0a51c27c3a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:43.194308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9274d-c788-448b-9072-aa0a51c27c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:43.220370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:43.263607 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3eb9274d-c788-448b-9072-aa0a51c27c3a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:43.264821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3eb9274d-c788-448b-9072-aa0a51c27c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:43.361216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 693/1393] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:43.417484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae6fa6-6471-4d5d-89d3-f0165ffb50a9 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:43.417776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae6fa6-6471-4d5d-89d3-f0165ffb50a9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:43.418033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae6fa6-6471-4d5d-89d3-f0165ffb50a9 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:43.419962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 701/1394] 10.222.0.45 () {54 vars in 967 bytes} [Wed Aug 10 08:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:43.424834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74d34-2651-42cd-8de2-38f1b8ec02cb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:43.425121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74d34-2651-42cd-8de2-38f1b8ec02cb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:43.425418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74d34-2651-42cd-8de2-38f1b8ec02cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:43.501276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c1c74d34-2651-42cd-8de2-38f1b8ec02cb None None] MFA Rules not processed for user `fb458a6186814aadb4ef178ff199582c`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:43.502402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c1c74d34-2651-42cd-8de2-38f1b8ec02cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:43.542433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:43.579418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 694/1395] 10.222.0.45 () {58 vars in 1064 bytes} [Wed Aug 10 08:34:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:43.587043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae6fa6-6471-4d5d-89d3-f0165ffb50a9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:43.588859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-61ae6fa6-6471-4d5d-89d3-f0165ffb50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:43.603239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:43.693101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae6fa6-6471-4d5d-89d3-f0165ffb50a9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:43.768124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b3095-29d9-4dc7-8eb6-ec281772dc79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb458a6186814aadb4ef178ff199582c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:43.768636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3095-29d9-4dc7-8eb6-ec281772dc79 service glance] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:43.768911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3095-29d9-4dc7-8eb6-ec281772dc79 service glance] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:43.769175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3095-29d9-4dc7-8eb6-ec281772dc79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:43.770789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7a9b3095-29d9-4dc7-8eb6-ec281772dc79 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:43.845204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:43.886676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b3095-29d9-4dc7-8eb6-ec281772dc79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:43.888096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b3095-29d9-4dc7-8eb6-ec281772dc79 service glance] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:43.905716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 702/1396] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:34:44.616694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24e3d-87a1-4294-8b3d-2129d2c56aa3 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:44.617240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24e3d-87a1-4294-8b3d-2129d2c56aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:44.617240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24e3d-87a1-4294-8b3d-2129d2c56aa3 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:44.618531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 695/1397] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:34:44.624365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17650b-bae4-4e08-969c-69eaf0052dae None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:44.624898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17650b-bae4-4e08-969c-69eaf0052dae None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:44.624898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17650b-bae4-4e08-969c-69eaf0052dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:44.691547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ae17650b-bae4-4e08-969c-69eaf0052dae None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:44.692785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ae17650b-bae4-4e08-969c-69eaf0052dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:44.790820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 703/1398] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:34:44.824189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952626b5-98d4-4516-bbe0-aba04d8eb191 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:44.825009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952626b5-98d4-4516-bbe0-aba04d8eb191 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:44.825311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952626b5-98d4-4516-bbe0-aba04d8eb191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:44.834038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17650b-bae4-4e08-969c-69eaf0052dae None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:44.835311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ae17650b-bae4-4e08-969c-69eaf0052dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:44.863088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:44.896933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-952626b5-98d4-4516-bbe0-aba04d8eb191 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:44.899564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-952626b5-98d4-4516-bbe0-aba04d8eb191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:44.958501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17650b-bae4-4e08-969c-69eaf0052dae None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:44.989703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 696/1399] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:34:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:45.040130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96b00b-8898-44e1-9ada-063988bf04b8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:45.040506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96b00b-8898-44e1-9ada-063988bf04b8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:45.040806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96b00b-8898-44e1-9ada-063988bf04b8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:45.042360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 697/1400] 10.222.0.45 () {54 vars in 943 bytes} [Wed Aug 10 08:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:34:45.049101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f94cd6-c29a-4444-bc14-6c3b5a64cb58 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:45.049375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f94cd6-c29a-4444-bc14-6c3b5a64cb58 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:45.049641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f94cd6-c29a-4444-bc14-6c3b5a64cb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:45.076202 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:45.076800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:45.077083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:45.077350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:45.079006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:45.096995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:45.119271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:45.129542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f8f94cd6-c29a-4444-bc14-6c3b5a64cb58 None None] MFA Rules not processed for user `d3dd402dbe75410aa87c433cbde181c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:45.130864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f8f94cd6-c29a-4444-bc14-6c3b5a64cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:45.168742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:45.170305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:45.188982 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 704/1401] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:34:45.238211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 698/1402] 10.222.0.45 () {58 vars in 1040 bytes} [Wed Aug 10 08:34:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:45.248529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:45.249724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:45.340768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64091ffc-d871-4d0e-9d04-0697cf014e45 service nova] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:45.400376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:45.455450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32266647-c040-460b-9c68-dfd40da7d398 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:45.456110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32266647-c040-460b-9c68-dfd40da7d398 service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:45.456462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32266647-c040-460b-9c68-dfd40da7d398 service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:45.457253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32266647-c040-460b-9c68-dfd40da7d398 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:45.459055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-32266647-c040-460b-9c68-dfd40da7d398 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:45.547848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32266647-c040-460b-9c68-dfd40da7d398 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:45.549447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32266647-c040-460b-9c68-dfd40da7d398 service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:45.557742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 705/1403] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:34:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:34:47.344362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85276a6-b44d-439e-b171-213e88c45ec6 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:47.344989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85276a6-b44d-439e-b171-213e88c45ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:47.344989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85276a6-b44d-439e-b171-213e88c45ec6 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:47.346411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 699/1404] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:47.351380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15513f84-e703-407f-a3b2-20ea0802c81f None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:47.351816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15513f84-e703-407f-a3b2-20ea0802c81f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:47.351933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15513f84-e703-407f-a3b2-20ea0802c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:47.426210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-15513f84-e703-407f-a3b2-20ea0802c81f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:47.428344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-15513f84-e703-407f-a3b2-20ea0802c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:47.474800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:47.538146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 706/1405] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:47.583426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85276a6-b44d-439e-b171-213e88c45ec6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:47.586971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d85276a6-b44d-439e-b171-213e88c45ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:47.714237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:47.752280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85276a6-b44d-439e-b171-213e88c45ec6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:47.879238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce613d0d-61a1-40aa-bfba-98a4f1f3ad47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:47.879946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce613d0d-61a1-40aa-bfba-98a4f1f3ad47 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:47.880225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce613d0d-61a1-40aa-bfba-98a4f1f3ad47 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:47.880494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce613d0d-61a1-40aa-bfba-98a4f1f3ad47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:47.882099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ce613d0d-61a1-40aa-bfba-98a4f1f3ad47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:47.973329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:47.987803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce613d0d-61a1-40aa-bfba-98a4f1f3ad47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:47.989396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce613d0d-61a1-40aa-bfba-98a4f1f3ad47 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:48.009445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 700/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:34:50.192852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377542-6441-4b67-9e13-842d9365dc92 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:50.193422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377542-6441-4b67-9e13-842d9365dc92 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:50.193422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377542-6441-4b67-9e13-842d9365dc92 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:50.198565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 707/1407] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:34:50.203015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0932f-7558-43d5-937a-2f03d9c4446d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:50.203500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0932f-7558-43d5-937a-2f03d9c4446d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:50.203590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0932f-7558-43d5-937a-2f03d9c4446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:50.276851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bed0932f-7558-43d5-937a-2f03d9c4446d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:34:50.278189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bed0932f-7558-43d5-937a-2f03d9c4446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:50.391924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 701/1408] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:34:50.438642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377542-6441-4b67-9e13-842d9365dc92 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:34:50.440179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-66377542-6441-4b67-9e13-842d9365dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:50.606171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377542-6441-4b67-9e13-842d9365dc92 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:34:50.632850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:50.731283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16b92a-2ce4-45a8-84c5-2b7c168c945b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:34:50.735355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16b92a-2ce4-45a8-84c5-2b7c168c945b service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:34:50.735355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16b92a-2ce4-45a8-84c5-2b7c168c945b service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:34:50.735355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16b92a-2ce4-45a8-84c5-2b7c168c945b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:34:50.735355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fd16b92a-2ce4-45a8-84c5-2b7c168c945b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:34:50.838162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16b92a-2ce4-45a8-84c5-2b7c168c945b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:34:50.840498 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16b92a-2ce4-45a8-84c5-2b7c168c945b service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:34:50.861350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 708/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:00.389627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=76 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:00.857359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=87 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:08.606387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3a00-f452-4394-85d6-6dc29dd671b3 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:08.606993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3a00-f452-4394-85d6-6dc29dd671b3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:08.606993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3a00-f452-4394-85d6-6dc29dd671b3 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:08.608299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 702/1410] 10.222.0.45 () {54 vars in 918 bytes} [Wed Aug 10 08:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:08.613293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a7b15-9248-4d1d-aec0-023aad986da5 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:08.613724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a7b15-9248-4d1d-aec0-023aad986da5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:08.613858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a7b15-9248-4d1d-aec0-023aad986da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:08.688551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ff3a7b15-9248-4d1d-aec0-023aad986da5 None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:08.689799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ff3a7b15-9248-4d1d-aec0-023aad986da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:08.794290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 709/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Aug 10 08:35:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:08.809880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15abd-fa1e-494f-ab42-8f62e1dc3a11 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:08.810159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15abd-fa1e-494f-ab42-8f62e1dc3a11 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:08.810429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15abd-fa1e-494f-ab42-8f62e1dc3a11 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:08.811817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 703/1412] 10.222.0.45 () {54 vars in 918 bytes} [Wed Aug 10 08:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:08.816713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e23d0-40b0-4f0e-8992-8c46ac52a39d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:08.817027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e23d0-40b0-4f0e-8992-8c46ac52a39d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:08.817308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e23d0-40b0-4f0e-8992-8c46ac52a39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:08.888917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:08.891766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-be7e23d0-40b0-4f0e-8992-8c46ac52a39d None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:08.893017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-be7e23d0-40b0-4f0e-8992-8c46ac52a39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:09.008855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 710/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Aug 10 08:35:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:11.458931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e014b48-ed64-4906-a1a3-e9f10830299a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:11.459509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e014b48-ed64-4906-a1a3-e9f10830299a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:11.459509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e014b48-ed64-4906-a1a3-e9f10830299a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:11.460855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:11.466112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06b08-0af7-42d9-85bf-1bfaf8431ba1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:11.466584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06b08-0af7-42d9-85bf-1bfaf8431ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:11.466694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06b08-0af7-42d9-85bf-1bfaf8431ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:11.531965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-34e06b08-0af7-42d9-85bf-1bfaf8431ba1 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:11.533089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-34e06b08-0af7-42d9-85bf-1bfaf8431ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:11.588766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:11.633402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:11.675955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e014b48-ed64-4906-a1a3-e9f10830299a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:11.677470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1e014b48-ed64-4906-a1a3-e9f10830299a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:11.820531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e014b48-ed64-4906-a1a3-e9f10830299a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:11.890519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:11.932619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823d10a-76e7-407b-9237-a5a3f622a3fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:11.933232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d10a-76e7-407b-9237-a5a3f622a3fb service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:11.933543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d10a-76e7-407b-9237-a5a3f622a3fb service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:11.933812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d10a-76e7-407b-9237-a5a3f622a3fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:11.935498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0823d10a-76e7-407b-9237-a5a3f622a3fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:12.022949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823d10a-76e7-407b-9237-a5a3f622a3fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:12.024539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823d10a-76e7-407b-9237-a5a3f622a3fb service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:12.042623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 705/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:12.931742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851e00-53d2-43d4-8e9e-081800081db4 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:12.932234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851e00-53d2-43d4-8e9e-081800081db4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:12.932350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851e00-53d2-43d4-8e9e-081800081db4 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:12.933626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:12.938781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940116-664f-4829-bb03-de5620526d70 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:12.939247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940116-664f-4829-bb03-de5620526d70 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:12.939350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940116-664f-4829-bb03-de5620526d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:13.016502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e8940116-664f-4829-bb03-de5620526d70 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:13.017716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e8940116-664f-4829-bb03-de5620526d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:13.044986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:13.114033 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:13.264139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851e00-53d2-43d4-8e9e-081800081db4 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:13.265662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4e851e00-53d2-43d4-8e9e-081800081db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:13.409829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851e00-53d2-43d4-8e9e-081800081db4 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:13.449048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:13.520460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e26f5-4147-43bf-aa6a-5bbc1e7654bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:13.520460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e26f5-4147-43bf-aa6a-5bbc1e7654bc service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:13.520460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e26f5-4147-43bf-aa6a-5bbc1e7654bc service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:13.520803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e26f5-4147-43bf-aa6a-5bbc1e7654bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:13.522249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f15e26f5-4147-43bf-aa6a-5bbc1e7654bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:13.610189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e26f5-4147-43bf-aa6a-5bbc1e7654bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:13.611808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e26f5-4147-43bf-aa6a-5bbc1e7654bc service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:13.632594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 713/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:14.509017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f1b47-5fa1-4911-bee6-51f17f28c2fc None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:14.509583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f1b47-5fa1-4911-bee6-51f17f28c2fc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:14.509583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f1b47-5fa1-4911-bee6-51f17f28c2fc None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:14.510962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:14.515930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c9e30-97c7-4411-b422-dbfb69141fb1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:14.516364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c9e30-97c7-4411-b422-dbfb69141fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:14.516478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c9e30-97c7-4411-b422-dbfb69141fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:14.570541 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:14.591772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-197c9e30-97c7-4411-b422-dbfb69141fb1 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:14.593037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-197c9e30-97c7-4411-b422-dbfb69141fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:14.689460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:14.841984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f1b47-5fa1-4911-bee6-51f17f28c2fc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:14.843353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f17f1b47-5fa1-4911-bee6-51f17f28c2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:14.990319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f1b47-5fa1-4911-bee6-51f17f28c2fc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:15.002998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:15.102695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13a4e5-71fb-4f80-9f23-5768b929f2e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:15.103228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13a4e5-71fb-4f80-9f23-5768b929f2e7 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:15.103503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13a4e5-71fb-4f80-9f23-5768b929f2e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:15.103769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13a4e5-71fb-4f80-9f23-5768b929f2e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:15.105373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db13a4e5-71fb-4f80-9f23-5768b929f2e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:15.194477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13a4e5-71fb-4f80-9f23-5768b929f2e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:15.196179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13a4e5-71fb-4f80-9f23-5768b929f2e7 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:15.214264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 708/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:16.068252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f0b6-3a3b-4212-b480-ff2115c9f9c6 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:16.068764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f0b6-3a3b-4212-b480-ff2115c9f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:16.068764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f0b6-3a3b-4212-b480-ff2115c9f9c6 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:16.070075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:16.075351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842643-390a-4741-814c-dfce3de60ff3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:16.075768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842643-390a-4741-814c-dfce3de60ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:16.075894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15842643-390a-4741-814c-dfce3de60ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:16.095796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:16.153641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-15842643-390a-4741-814c-dfce3de60ff3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:16.154915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-15842643-390a-4741-814c-dfce3de60ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:16.249421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:16.400360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f0b6-3a3b-4212-b480-ff2115c9f9c6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:16.401804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-17e4f0b6-3a3b-4212-b480-ff2115c9f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:16.508105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:16.542963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f0b6-3a3b-4212-b480-ff2115c9f9c6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:16.656093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5179da1-2051-4c45-bc7f-307421720945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:16.656619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5179da1-2051-4c45-bc7f-307421720945 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:16.656902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5179da1-2051-4c45-bc7f-307421720945 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:16.657177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5179da1-2051-4c45-bc7f-307421720945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:16.658813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d5179da1-2051-4c45-bc7f-307421720945 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:16.733772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:16.746884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5179da1-2051-4c45-bc7f-307421720945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:16.748481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5179da1-2051-4c45-bc7f-307421720945 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:16.766600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 716/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:17.616711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd42b-21fe-49e4-b0cc-f13c8d8d41d2 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:17.617313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd42b-21fe-49e4-b0cc-f13c8d8d41d2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:17.617313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd42b-21fe-49e4-b0cc-f13c8d8d41d2 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:17.618678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:17.624394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a25e8-0380-41f2-9806-30b815e84df7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:17.624882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a25e8-0380-41f2-9806-30b815e84df7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:17.624993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a25e8-0380-41f2-9806-30b815e84df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:17.698788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4a0a25e8-0380-41f2-9806-30b815e84df7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:17.700025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4a0a25e8-0380-41f2-9806-30b815e84df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:17.793604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:17.944464 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbd42b-21fe-49e4-b0cc-f13c8d8d41d2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:17.945972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-14cbd42b-21fe-49e4-b0cc-f13c8d8d41d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:18.026453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:18.086460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbd42b-21fe-49e4-b0cc-f13c8d8d41d2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:18.196167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b1f9d-960a-4181-b41a-f64a02a465e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:18.196695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b1f9d-960a-4181-b41a-f64a02a465e4 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:18.196968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b1f9d-960a-4181-b41a-f64a02a465e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:18.197235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b1f9d-960a-4181-b41a-f64a02a465e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:18.198849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-656b1f9d-960a-4181-b41a-f64a02a465e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:18.245947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:18.286827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b1f9d-960a-4181-b41a-f64a02a465e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:18.288417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b1f9d-960a-4181-b41a-f64a02a465e4 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:18.306243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 711/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:19.220476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b551d-027d-46d8-90cb-664caf4afd12 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:19.221159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b551d-027d-46d8-90cb-664caf4afd12 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:19.221159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b551d-027d-46d8-90cb-664caf4afd12 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:19.222361 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:19.227134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ffca-bb70-4691-aa00-fb73424f28c1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:19.227549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ffca-bb70-4691-aa00-fb73424f28c1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:19.227661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ffca-bb70-4691-aa00-fb73424f28c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:19.304232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3cf6ffca-bb70-4691-aa00-fb73424f28c1 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:19.305438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3cf6ffca-bb70-4691-aa00-fb73424f28c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:19.400109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:19.551204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b551d-027d-46d8-90cb-664caf4afd12 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:19.552646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-559b551d-027d-46d8-90cb-664caf4afd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:19.601877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:19.697084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b551d-027d-46d8-90cb-664caf4afd12 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:19.806884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c318a6-3765-4501-8380-61005b6daaf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:19.807412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c318a6-3765-4501-8380-61005b6daaf5 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:19.807688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c318a6-3765-4501-8380-61005b6daaf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:19.807956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c318a6-3765-4501-8380-61005b6daaf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:19.809563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-19c318a6-3765-4501-8380-61005b6daaf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:19.816296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:19.896987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c318a6-3765-4501-8380-61005b6daaf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:19.898602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c318a6-3765-4501-8380-61005b6daaf5 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:19.916707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 719/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:20.775581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78ab59-564b-4de9-8315-1ea3b9945de9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:20.776128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78ab59-564b-4de9-8315-1ea3b9945de9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:20.776128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78ab59-564b-4de9-8315-1ea3b9945de9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:20.777534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:20.782301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e53ff-9213-416a-830c-000fe9c974d0 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:20.782823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e53ff-9213-416a-830c-000fe9c974d0 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:20.782918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e53ff-9213-416a-830c-000fe9c974d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:20.858719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-999e53ff-9213-416a-830c-000fe9c974d0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:20.859936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-999e53ff-9213-416a-830c-000fe9c974d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:21.045061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:21.072725 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:21.222049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78ab59-564b-4de9-8315-1ea3b9945de9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:21.223621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6a78ab59-564b-4de9-8315-1ea3b9945de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:21.241375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:21.372101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78ab59-564b-4de9-8315-1ea3b9945de9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:21.457960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:21.483269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a75f74-3da5-4c59-8d97-6158468ee6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:21.483866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a75f74-3da5-4c59-8d97-6158468ee6e4 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:21.484135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a75f74-3da5-4c59-8d97-6158468ee6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:21.484398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a75f74-3da5-4c59-8d97-6158468ee6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:21.485971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03a75f74-3da5-4c59-8d97-6158468ee6e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:21.573328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a75f74-3da5-4c59-8d97-6158468ee6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:21.575731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a75f74-3da5-4c59-8d97-6158468ee6e4 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:21.593958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 714/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:22.463773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef74e-2266-4c15-82f2-5d0e46d565c2 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:22.464320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef74e-2266-4c15-82f2-5d0e46d565c2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:22.464447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ef74e-2266-4c15-82f2-5d0e46d565c2 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:22.465721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:22.470582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00360ad6-8c56-445d-9288-dd05f230f79a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:22.470990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00360ad6-8c56-445d-9288-dd05f230f79a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:22.471124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00360ad6-8c56-445d-9288-dd05f230f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:22.546010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-00360ad6-8c56-445d-9288-dd05f230f79a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:22.547220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-00360ad6-8c56-445d-9288-dd05f230f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:22.588316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:22.642817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:22.791287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ef74e-2266-4c15-82f2-5d0e46d565c2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:22.793179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-749ef74e-2266-4c15-82f2-5d0e46d565c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:22.934671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ef74e-2266-4c15-82f2-5d0e46d565c2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:22.986972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:23.044943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce96c5-d5ec-4284-a39b-0a7589dac55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:23.045463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce96c5-d5ec-4284-a39b-0a7589dac55b service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:23.045732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce96c5-d5ec-4284-a39b-0a7589dac55b service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:23.045993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce96c5-d5ec-4284-a39b-0a7589dac55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:23.047595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-01ce96c5-d5ec-4284-a39b-0a7589dac55b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:23.133832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce96c5-d5ec-4284-a39b-0a7589dac55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:23.135459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce96c5-d5ec-4284-a39b-0a7589dac55b service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:23.153359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 722/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:23.997948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97abf96-839e-468e-bb55-aaad45e5da2d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:23.998526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97abf96-839e-468e-bb55-aaad45e5da2d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:23.998526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97abf96-839e-468e-bb55-aaad45e5da2d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:24.000019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:24.004944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311894-c38a-4a3e-abe3-1fcee2bdc2b4 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:24.005380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311894-c38a-4a3e-abe3-1fcee2bdc2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:24.005487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311894-c38a-4a3e-abe3-1fcee2bdc2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:24.080671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-31311894-c38a-4a3e-abe3-1fcee2bdc2b4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:24.081922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-31311894-c38a-4a3e-abe3-1fcee2bdc2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:24.084007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:24.175474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:24.323352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97abf96-839e-468e-bb55-aaad45e5da2d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:24.324831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c97abf96-839e-468e-bb55-aaad45e5da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:24.467166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97abf96-839e-468e-bb55-aaad45e5da2d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:24.494625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:24.579079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a307c8-98ac-46e7-bf87-70b15e31de50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:24.579620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a307c8-98ac-46e7-bf87-70b15e31de50 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:24.579892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a307c8-98ac-46e7-bf87-70b15e31de50 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:24.580153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a307c8-98ac-46e7-bf87-70b15e31de50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:24.581732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-93a307c8-98ac-46e7-bf87-70b15e31de50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:24.681959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a307c8-98ac-46e7-bf87-70b15e31de50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:24.683600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a307c8-98ac-46e7-bf87-70b15e31de50 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:24.701285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 717/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:26.615846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9b91-5ff3-4adb-ac1c-5161cad7d34d None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:26.616413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9b91-5ff3-4adb-ac1c-5161cad7d34d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:26.616413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9b91-5ff3-4adb-ac1c-5161cad7d34d None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:26.617736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:26.622998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166173d-413b-4b1c-a378-345587bbe9bc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:26.623443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166173d-413b-4b1c-a378-345587bbe9bc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:26.623550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166173d-413b-4b1c-a378-345587bbe9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:26.664413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:26.689610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1166173d-413b-4b1c-a378-345587bbe9bc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:26.690841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1166173d-413b-4b1c-a378-345587bbe9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:26.786652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:26.825671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a9b91-5ff3-4adb-ac1c-5161cad7d34d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:26.827226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fb8a9b91-5ff3-4adb-ac1c-5161cad7d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:26.928586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a9b91-5ff3-4adb-ac1c-5161cad7d34d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:26.960860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:27.004214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9fce-7a97-4d01-b52f-93b3a3cbc4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:27.004817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9fce-7a97-4d01-b52f-93b3a3cbc4ba service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:27.005093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9fce-7a97-4d01-b52f-93b3a3cbc4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:27.005360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9fce-7a97-4d01-b52f-93b3a3cbc4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:27.006995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-844d9fce-7a97-4d01-b52f-93b3a3cbc4ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:27.111832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d9fce-7a97-4d01-b52f-93b3a3cbc4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:27.113251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d9fce-7a97-4d01-b52f-93b3a3cbc4ba service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:27.131487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 725/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:29.278424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d488f2-ade5-4b76-9581-c3c5519cc07d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:29.278990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d488f2-ade5-4b76-9581-c3c5519cc07d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:29.278990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d488f2-ade5-4b76-9581-c3c5519cc07d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:29.280624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:29.285546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3b71-e540-4366-afea-7689dae1c8b3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:29.285972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3b71-e540-4366-afea-7689dae1c8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:29.286089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3b71-e540-4366-afea-7689dae1c8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:29.353404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d72e3b71-e540-4366-afea-7689dae1c8b3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:29.354685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d72e3b71-e540-4366-afea-7689dae1c8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:29.368258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:29.449846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:29.487751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d488f2-ade5-4b76-9581-c3c5519cc07d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:29.489274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b5d488f2-ade5-4b76-9581-c3c5519cc07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:29.595884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d488f2-ade5-4b76-9581-c3c5519cc07d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:29.607718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:29.668891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b2ed6-a52e-478a-a160-fcfee79d6984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:29.669498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2ed6-a52e-478a-a160-fcfee79d6984 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:29.670010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2ed6-a52e-478a-a160-fcfee79d6984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:29.670441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2ed6-a52e-478a-a160-fcfee79d6984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:29.672467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6f2b2ed6-a52e-478a-a160-fcfee79d6984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:29.778546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b2ed6-a52e-478a-a160-fcfee79d6984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:29.779979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b2ed6-a52e-478a-a160-fcfee79d6984 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:29.798230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 720/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:32.152447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92817cb-d0bb-4468-878b-87043483060e None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:32.153004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92817cb-d0bb-4468-878b-87043483060e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:32.153004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92817cb-d0bb-4468-878b-87043483060e None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:32.154320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:32.159557 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3cc2d-c2fd-4df3-ad92-a97677167bab None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:32.159961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3cc2d-c2fd-4df3-ad92-a97677167bab None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:32.160100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3cc2d-c2fd-4df3-ad92-a97677167bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:32.207473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:32.226958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-34f3cc2d-c2fd-4df3-ad92-a97677167bab None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:32.228163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-34f3cc2d-c2fd-4df3-ad92-a97677167bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:32.323133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:32.362897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92817cb-d0bb-4468-878b-87043483060e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:32.364448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b92817cb-d0bb-4468-878b-87043483060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:32.465069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92817cb-d0bb-4468-878b-87043483060e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:32.503702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:32.536597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d4d4f-aada-48cd-8412-77cd5f1c14a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:32.537184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4d4f-aada-48cd-8412-77cd5f1c14a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:32.537454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4d4f-aada-48cd-8412-77cd5f1c14a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:32.537718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d4d4f-aada-48cd-8412-77cd5f1c14a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:32.540021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7b1d4d4f-aada-48cd-8412-77cd5f1c14a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:32.643792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d4d4f-aada-48cd-8412-77cd5f1c14a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:32.645198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d4d4f-aada-48cd-8412-77cd5f1c14a7 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:32.663382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 728/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:34.764488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbe007-099c-4d58-a413-2b04ff8f7520 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:34.765049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbe007-099c-4d58-a413-2b04ff8f7520 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:34.765049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbe007-099c-4d58-a413-2b04ff8f7520 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:34.766431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:34.771953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db45cd-99f3-4d00-af6c-56b95a46b1cd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:34.772393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db45cd-99f3-4d00-af6c-56b95a46b1cd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:34.772564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db45cd-99f3-4d00-af6c-56b95a46b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:34.837084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-92db45cd-99f3-4d00-af6c-56b95a46b1cd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:34.838286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-92db45cd-99f3-4d00-af6c-56b95a46b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:34.859040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:34.937852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:35:34.977636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbe007-099c-4d58-a413-2b04ff8f7520 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:34.979183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c4cbe007-099c-4d58-a413-2b04ff8f7520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:35.080711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbe007-099c-4d58-a413-2b04ff8f7520 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:35.100481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:35.153373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670e674-9e2c-4584-a551-88e0f367fa66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:35.153969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670e674-9e2c-4584-a551-88e0f367fa66 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:35.154243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670e674-9e2c-4584-a551-88e0f367fa66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:35.154536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670e674-9e2c-4584-a551-88e0f367fa66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:35.156112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2670e674-9e2c-4584-a551-88e0f367fa66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:35.264320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670e674-9e2c-4584-a551-88e0f367fa66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:35.265751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670e674-9e2c-4584-a551-88e0f367fa66 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:35.283426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 723/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:37.314488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6a33-af26-4353-856f-e32ce1202550 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:37.315027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6a33-af26-4353-856f-e32ce1202550 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:37.315027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6a33-af26-4353-856f-e32ce1202550 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:37.316307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:37.321687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676290a9-388d-48bc-9aad-ec51873eb026 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:37.322119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676290a9-388d-48bc-9aad-ec51873eb026 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:37.322227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676290a9-388d-48bc-9aad-ec51873eb026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:37.385073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:37.388470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-676290a9-388d-48bc-9aad-ec51873eb026 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:37.389677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-676290a9-388d-48bc-9aad-ec51873eb026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:37.486136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:37.525237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a6a33-af26-4353-856f-e32ce1202550 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:37.526858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-187a6a33-af26-4353-856f-e32ce1202550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:37.627427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a6a33-af26-4353-856f-e32ce1202550 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:37.674804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:37.700439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf27fb-5b26-4edf-9570-a2cb4a17f35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:37.701020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf27fb-5b26-4edf-9570-a2cb4a17f35b service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:37.701293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf27fb-5b26-4edf-9570-a2cb4a17f35b service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:37.701555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf27fb-5b26-4edf-9570-a2cb4a17f35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:37.703172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5ccf27fb-5b26-4edf-9570-a2cb4a17f35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:37.808376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf27fb-5b26-4edf-9570-a2cb4a17f35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:37.809786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf27fb-5b26-4edf-9570-a2cb4a17f35b service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:37.828187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 731/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:39.869674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1467-ac80-4edd-bed3-ec47751cb361 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:39.870243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1467-ac80-4edd-bed3-ec47751cb361 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:39.870243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1467-ac80-4edd-bed3-ec47751cb361 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:39.871633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:39.876792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b5e9-e98a-4506-8a38-f26e413501b7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:39.877238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b5e9-e98a-4506-8a38-f26e413501b7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:39.877336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b5e9-e98a-4506-8a38-f26e413501b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:39.942617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9a43b5e9-e98a-4506-8a38-f26e413501b7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:39.944161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9a43b5e9-e98a-4506-8a38-f26e413501b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:39.972854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:40.040441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:40.079145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f1467-ac80-4edd-bed3-ec47751cb361 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:40.080695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aa8f1467-ac80-4edd-bed3-ec47751cb361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:40.187839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f1467-ac80-4edd-bed3-ec47751cb361 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:40.216289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:40.260257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b079ec2-0061-4ea3-a575-2402a5339f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:40.261385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079ec2-0061-4ea3-a575-2402a5339f26 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:40.261656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079ec2-0061-4ea3-a575-2402a5339f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:40.261919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079ec2-0061-4ea3-a575-2402a5339f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:40.263537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3b079ec2-0061-4ea3-a575-2402a5339f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:40.369876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b079ec2-0061-4ea3-a575-2402a5339f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:40.371836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b079ec2-0061-4ea3-a575-2402a5339f26 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:40.390459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 726/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:42.434884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918006a7-c7f8-4b76-81aa-0e1975164309 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:42.435408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918006a7-c7f8-4b76-81aa-0e1975164309 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:42.435408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918006a7-c7f8-4b76-81aa-0e1975164309 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:42.436771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:42.441895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd84ac-1761-47c6-a549-5395e7032505 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:42.442348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd84ac-1761-47c6-a549-5395e7032505 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:42.442446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd84ac-1761-47c6-a549-5395e7032505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:42.506816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-babd84ac-1761-47c6-a549-5395e7032505 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:42.507994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-babd84ac-1761-47c6-a549-5395e7032505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:42.516552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:42.604496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:42.642272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918006a7-c7f8-4b76-81aa-0e1975164309 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:42.643823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-918006a7-c7f8-4b76-81aa-0e1975164309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:42.743918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918006a7-c7f8-4b76-81aa-0e1975164309 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:42.797469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:42.816031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e7269-0e77-43a6-94e9-151ac217a15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:42.816620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e7269-0e77-43a6-94e9-151ac217a15b service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:42.816891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e7269-0e77-43a6-94e9-151ac217a15b service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:42.817152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e7269-0e77-43a6-94e9-151ac217a15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:42.818739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e91e7269-0e77-43a6-94e9-151ac217a15b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:42.922594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e7269-0e77-43a6-94e9-151ac217a15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:42.924268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e7269-0e77-43a6-94e9-151ac217a15b service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:42.943566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 734/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:45.074289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ec12-c5de-4716-8b57-28747702da6f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:45.074886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ec12-c5de-4716-8b57-28747702da6f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:45.074886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ec12-c5de-4716-8b57-28747702da6f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:45.076219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:45.081605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8af126-fa5f-45ca-8481-c565b87bf70e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:45.081992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8af126-fa5f-45ca-8481-c565b87bf70e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:45.082145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8af126-fa5f-45ca-8481-c565b87bf70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:45.145670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ca8af126-fa5f-45ca-8481-c565b87bf70e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:45.146895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ca8af126-fa5f-45ca-8481-c565b87bf70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:45.184343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:45.242214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:45.280120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1ec12-c5de-4716-8b57-28747702da6f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:45.281754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-55c1ec12-c5de-4716-8b57-28747702da6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:45.393013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1ec12-c5de-4716-8b57-28747702da6f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:45.430127 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:45.473133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c70da-3d71-4724-b651-97fd215d9be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:45.473821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c70da-3d71-4724-b651-97fd215d9be9 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:45.474132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c70da-3d71-4724-b651-97fd215d9be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:45.474407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c70da-3d71-4724-b651-97fd215d9be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:45.476805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-979c70da-3d71-4724-b651-97fd215d9be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:45.584253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c70da-3d71-4724-b651-97fd215d9be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:45.585715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c70da-3d71-4724-b651-97fd215d9be9 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:45.604162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 729/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:47.584591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2938-224b-4a29-8dbe-4c705eb8b5ed None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:47.585161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2938-224b-4a29-8dbe-4c705eb8b5ed None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:47.585161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2938-224b-4a29-8dbe-4c705eb8b5ed None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:47.586559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:47.592297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5910d22-3e86-4bdd-b247-2e2e4a1abdf0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:47.592701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5910d22-3e86-4bdd-b247-2e2e4a1abdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:47.592832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5910d22-3e86-4bdd-b247-2e2e4a1abdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:47.656800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c5910d22-3e86-4bdd-b247-2e2e4a1abdf0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:47.657979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c5910d22-3e86-4bdd-b247-2e2e4a1abdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:47.675443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:47.751610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:35:47.788562 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd2938-224b-4a29-8dbe-4c705eb8b5ed None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:47.790099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-78dd2938-224b-4a29-8dbe-4c705eb8b5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:47.892158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd2938-224b-4a29-8dbe-4c705eb8b5ed None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:47.957698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:47.964395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cc348-d8f4-4c0e-941e-390ec8bfa8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:47.965096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc348-d8f4-4c0e-941e-390ec8bfa8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:47.965367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc348-d8f4-4c0e-941e-390ec8bfa8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:47.965633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc348-d8f4-4c0e-941e-390ec8bfa8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:47.967261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7d6cc348-d8f4-4c0e-941e-390ec8bfa8c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:48.071990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cc348-d8f4-4c0e-941e-390ec8bfa8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:48.074015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cc348-d8f4-4c0e-941e-390ec8bfa8c5 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:48.093275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 737/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:50.116469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8982717-1e47-49f0-9de1-737c9cb2bcef None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:50.117035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8982717-1e47-49f0-9de1-737c9cb2bcef None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:50.117035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8982717-1e47-49f0-9de1-737c9cb2bcef None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:50.118380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:35:50.124283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8b07-3f0a-4fa3-95e1-c1acf8fe7b7a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:50.125088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8b07-3f0a-4fa3-95e1-c1acf8fe7b7a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:50.125363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8b07-3f0a-4fa3-95e1-c1acf8fe7b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:50.191206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-660d8b07-3f0a-4fa3-95e1-c1acf8fe7b7a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:35:50.192467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-660d8b07-3f0a-4fa3-95e1-c1acf8fe7b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:50.241482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:50.290488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:35:50.327767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8982717-1e47-49f0-9de1-737c9cb2bcef None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:35:50.329380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a8982717-1e47-49f0-9de1-737c9cb2bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:50.431848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8982717-1e47-49f0-9de1-737c9cb2bcef None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:35:50.478664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:50.505376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab0d17-c408-44b6-9970-ff55b2db8198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:35:50.506058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab0d17-c408-44b6-9970-ff55b2db8198 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:35:50.506334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab0d17-c408-44b6-9970-ff55b2db8198 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:35:50.506635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab0d17-c408-44b6-9970-ff55b2db8198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:35:50.508555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2aab0d17-c408-44b6-9970-ff55b2db8198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:35:50.617184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab0d17-c408-44b6-9970-ff55b2db8198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:35:50.618659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab0d17-c408-44b6-9970-ff55b2db8198 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:35:50.637675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 732/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:36:00.292304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=22 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:00.635824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=66 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:10.080873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52855f5-faa6-4f00-bbeb-5661bde808dc None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:10.081438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52855f5-faa6-4f00-bbeb-5661bde808dc None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:10.081438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52855f5-faa6-4f00-bbeb-5661bde808dc None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:10.082844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 739/1471] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:36:10.088029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71d791-1f91-47f4-bd5e-e315e2a27e6d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:10.088468 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71d791-1f91-47f4-bd5e-e315e2a27e6d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:10.088598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71d791-1f91-47f4-bd5e-e315e2a27e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:10.153333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3b71d791-1f91-47f4-bd5e-e315e2a27e6d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:36:10.154567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3b71d791-1f91-47f4-bd5e-e315e2a27e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:10.250113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 733/1472] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:36:10.333046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd270-bd34-48b8-8412-f4c230b221f9 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:10.334747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd270-bd34-48b8-8412-f4c230b221f9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:10.334747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd270-bd34-48b8-8412-f4c230b221f9 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:10.334963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 740/1473] 10.222.0.45 () {54 vars in 967 bytes} [Wed Aug 10 08:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:36:10.340857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434d16-8825-4a6b-91bb-108294e7d139 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:10.341174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434d16-8825-4a6b-91bb-108294e7d139 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:10.341453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd434d16-8825-4a6b-91bb-108294e7d139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:10.419279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fd434d16-8825-4a6b-91bb-108294e7d139 None None] MFA Rules not processed for user `fb458a6186814aadb4ef178ff199582c`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:36:10.420485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fd434d16-8825-4a6b-91bb-108294e7d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:10.441412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:10.497219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 734/1474] 10.222.0.45 () {58 vars in 1064 bytes} [Wed Aug 10 08:36:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:36:10.504887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd270-bd34-48b8-8412-f4c230b221f9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:36:10.506337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-53fcd270-bd34-48b8-8412-f4c230b221f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:10.608608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd270-bd34-48b8-8412-f4c230b221f9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:36:10.682814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88d7a6-21b6-48f0-a117-d22dc99ea540 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb458a6186814aadb4ef178ff199582c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:36:10.683405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d7a6-21b6-48f0-a117-d22dc99ea540 service glance] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:10.683679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d7a6-21b6-48f0-a117-d22dc99ea540 service glance] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:10.683944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d7a6-21b6-48f0-a117-d22dc99ea540 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:10.685524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2e88d7a6-21b6-48f0-a117-d22dc99ea540 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:10.738839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:10.792604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88d7a6-21b6-48f0-a117-d22dc99ea540 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:36:10.793976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88d7a6-21b6-48f0-a117-d22dc99ea540 service glance] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:36:10.812633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 741/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:36:12.892633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d28be-599e-4900-a515-facdffc91fc0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:12.893218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d28be-599e-4900-a515-facdffc91fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:12.893218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d28be-599e-4900-a515-facdffc91fc0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:12.894532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 735/1476] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:36:12.899679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b1485-e101-46e4-8a04-35518b6eda5d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:12.900122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b1485-e101-46e4-8a04-35518b6eda5d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:12.900284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b1485-e101-46e4-8a04-35518b6eda5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:12.966123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-700b1485-e101-46e4-8a04-35518b6eda5d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:36:12.967362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-700b1485-e101-46e4-8a04-35518b6eda5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:13.061882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 742/1477] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:36:13.084408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d28be-599e-4900-a515-facdffc91fc0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:36:13.085982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f99d28be-599e-4900-a515-facdffc91fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:13.208238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d28be-599e-4900-a515-facdffc91fc0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:36:13.256177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:13.299715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11fc7d-e6e1-44ec-a358-0c96f34256f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:36:13.300312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11fc7d-e6e1-44ec-a358-0c96f34256f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:13.300583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11fc7d-e6e1-44ec-a358-0c96f34256f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:13.300850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11fc7d-e6e1-44ec-a358-0c96f34256f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:13.301479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11fc7d-e6e1-44ec-a358-0c96f34256f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:36:13.303239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING py.warnings [None req-7d11fc7d-e6e1-44ec-a358-0c96f34256f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:36:13.303239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: warnings.warn(msg) Aug 10 08:36:13.303239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: Aug 10 08:36:13.304377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11fc7d-e6e1-44ec-a358-0c96f34256f5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:36:13.323213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 736/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 10 08:36:13 2022] GET /identity/v3/projects => generated 2553 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:36:15.346969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74753df-8199-4473-802c-4d323f22ae96 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:15.347509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74753df-8199-4473-802c-4d323f22ae96 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:15.347509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74753df-8199-4473-802c-4d323f22ae96 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:15.348769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 743/1479] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:36:15.354139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167821-b0f2-45d3-b1ad-4718b2ee1d40 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:15.354555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167821-b0f2-45d3-b1ad-4718b2ee1d40 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:15.354711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167821-b0f2-45d3-b1ad-4718b2ee1d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:15.419235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-76167821-b0f2-45d3-b1ad-4718b2ee1d40 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:36:15.420430 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-76167821-b0f2-45d3-b1ad-4718b2ee1d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:15.515701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 737/1480] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:36:15.558498 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74753df-8199-4473-802c-4d323f22ae96 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:36:15.560030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c74753df-8199-4473-802c-4d323f22ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:15.569687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:15.705501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74753df-8199-4473-802c-4d323f22ae96 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:36:15.784419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:15.816659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4836d84-db71-4b23-95d6-bd857b436349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:36:15.817493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836d84-db71-4b23-95d6-bd857b436349 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:15.817878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836d84-db71-4b23-95d6-bd857b436349 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:15.818456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836d84-db71-4b23-95d6-bd857b436349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:15.820077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c4836d84-db71-4b23-95d6-bd857b436349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:15.907502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4836d84-db71-4b23-95d6-bd857b436349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:36:15.909085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4836d84-db71-4b23-95d6-bd857b436349 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:36:15.927575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 744/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:36:18.099429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f099ef9-a57d-4221-8a6b-cfbda8a8db4e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:18.099959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f099ef9-a57d-4221-8a6b-cfbda8a8db4e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:18.099959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f099ef9-a57d-4221-8a6b-cfbda8a8db4e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:18.101263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 738/1482] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:36:18.106759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397aecb-3cce-4fc6-883c-7a4b94e939f9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:18.107188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397aecb-3cce-4fc6-883c-7a4b94e939f9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:18.107309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397aecb-3cce-4fc6-883c-7a4b94e939f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:18.171708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9397aecb-3cce-4fc6-883c-7a4b94e939f9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:36:18.173177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9397aecb-3cce-4fc6-883c-7a4b94e939f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:18.217989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:18.267317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 745/1483] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:36:18.303743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f099ef9-a57d-4221-8a6b-cfbda8a8db4e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:36:18.305257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1f099ef9-a57d-4221-8a6b-cfbda8a8db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:18.328766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:18.407821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f099ef9-a57d-4221-8a6b-cfbda8a8db4e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:36:18.480110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5bec0-b933-4591-83c8-ca70ee4f22ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:36:18.480692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5bec0-b933-4591-83c8-ca70ee4f22ea service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:18.480962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5bec0-b933-4591-83c8-ca70ee4f22ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:18.481228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5bec0-b933-4591-83c8-ca70ee4f22ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:18.482864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b4f5bec0-b933-4591-83c8-ca70ee4f22ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:18.554339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:18.588827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5bec0-b933-4591-83c8-ca70ee4f22ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:36:18.590265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5bec0-b933-4591-83c8-ca70ee4f22ea service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:36:18.610233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 739/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:36:20.644750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197b93-5312-4152-b183-89340d7c389c None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:20.645325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197b93-5312-4152-b183-89340d7c389c None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:20.645325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197b93-5312-4152-b183-89340d7c389c None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:20.646664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 746/1485] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:36:20.652350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35a0d-c603-4f87-9f49-40dac4b5b471 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:20.652765 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35a0d-c603-4f87-9f49-40dac4b5b471 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:20.652895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35a0d-c603-4f87-9f49-40dac4b5b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:20.717489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f0a35a0d-c603-4f87-9f49-40dac4b5b471 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:36:20.718722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f0a35a0d-c603-4f87-9f49-40dac4b5b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:20.816827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 740/1486] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:36:20.855516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197b93-5312-4152-b183-89340d7c389c None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:36:20.857075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-92197b93-5312-4152-b183-89340d7c389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:20.959381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197b93-5312-4152-b183-89340d7c389c None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:36:21.029351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:21.031181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e8a9b-07cd-4a9a-a9b4-c2418f5def28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:36:21.031783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e8a9b-07cd-4a9a-a9b4-c2418f5def28 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:21.032059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e8a9b-07cd-4a9a-a9b4-c2418f5def28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:21.032326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e8a9b-07cd-4a9a-a9b4-c2418f5def28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:21.033921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7e8e8a9b-07cd-4a9a-a9b4-c2418f5def28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:21.141416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e8a9b-07cd-4a9a-a9b4-c2418f5def28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:36:21.142792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e8a9b-07cd-4a9a-a9b4-c2418f5def28 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:36:21.160160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 747/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:36:23.236050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f02c4-d888-4f16-a15e-eb0284deb7a8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:23.236586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f02c4-d888-4f16-a15e-eb0284deb7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:23.236586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f02c4-d888-4f16-a15e-eb0284deb7a8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:23.237899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 741/1488] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:36:23.242974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6974fc-841e-4625-be05-92601d499521 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:23.243866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6974fc-841e-4625-be05-92601d499521 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:23.244007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6974fc-841e-4625-be05-92601d499521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:23.309611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-fd6974fc-841e-4625-be05-92601d499521 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:36:23.310859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fd6974fc-841e-4625-be05-92601d499521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:23.364266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:23.408097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 748/1489] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:36:23.449295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f02c4-d888-4f16-a15e-eb0284deb7a8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:36:23.450905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-020f02c4-d888-4f16-a15e-eb0284deb7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:23.486641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:23.551532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f02c4-d888-4f16-a15e-eb0284deb7a8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:36:23.621897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b520a9-c241-4d2f-a331-5c0e87ac691e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:36:23.622517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520a9-c241-4d2f-a331-5c0e87ac691e service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:23.622791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520a9-c241-4d2f-a331-5c0e87ac691e service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:23.623054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b520a9-c241-4d2f-a331-5c0e87ac691e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:23.624625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-04b520a9-c241-4d2f-a331-5c0e87ac691e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:23.704617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:23.734883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b520a9-c241-4d2f-a331-5c0e87ac691e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:36:23.736307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b520a9-c241-4d2f-a331-5c0e87ac691e service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:36:23.755181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 742/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:36:26.063257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbae95-090f-4ad5-bd2b-df6ceb1ae158 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:26.063860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbae95-090f-4ad5-bd2b-df6ceb1ae158 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:26.063860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbae95-090f-4ad5-bd2b-df6ceb1ae158 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:26.065140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 749/1491] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 10 08:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:36:26.070359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78217b4-a65d-4d88-a474-dd1e1e951bde None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:26.070928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78217b4-a65d-4d88-a474-dd1e1e951bde None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:26.070928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78217b4-a65d-4d88-a474-dd1e1e951bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:26.135206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b78217b4-a65d-4d88-a474-dd1e1e951bde None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:36:26.136392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b78217b4-a65d-4d88-a474-dd1e1e951bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:26.231622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 743/1492] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 10 08:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:36:26.269882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbae95-090f-4ad5-bd2b-df6ceb1ae158 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:36:26.271443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d1cbae95-090f-4ad5-bd2b-df6ceb1ae158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:26.372873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbae95-090f-4ad5-bd2b-df6ceb1ae158 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:36:26.443233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb81ec-d8ea-415a-b23d-b18043ce788b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:36:26.443826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb81ec-d8ea-415a-b23d-b18043ce788b service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:36:26.444099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb81ec-d8ea-415a-b23d-b18043ce788b service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:36:26.444365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb81ec-d8ea-415a-b23d-b18043ce788b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:36:26.445935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4cdb81ec-d8ea-415a-b23d-b18043ce788b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:36:26.454722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:26.552508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb81ec-d8ea-415a-b23d-b18043ce788b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:36:26.553840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb81ec-d8ea-415a-b23d-b18043ce788b service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:36:26.571677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 750/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:36:36.229797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=82 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:36.569030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=50 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:00.063618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8cdfa-3dab-42e8-ab63-0217a66a49d8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:00.064233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8cdfa-3dab-42e8-ab63-0217a66a49d8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:00.064233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8cdfa-3dab-42e8-ab63-0217a66a49d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:00.161581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8cd8cdfa-3dab-42e8-ab63-0217a66a49d8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:38:00.163405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8cd8cdfa-3dab-42e8-ab63-0217a66a49d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:00.267344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 744/1494] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:38:00.275411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c63f60-5e18-4613-8d27-1ce607f8efdd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:00.275901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c63f60-5e18-4613-8d27-1ce607f8efdd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:00.276008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c63f60-5e18-4613-8d27-1ce607f8efdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:00.351997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b9c63f60-5e18-4613-8d27-1ce607f8efdd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:38:00.353203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b9c63f60-5e18-4613-8d27-1ce607f8efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:00.447992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 751/1495] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:38:00.452652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8cdfa-3dab-42e8-ab63-0217a66a49d8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:00.453880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8cd8cdfa-3dab-42e8-ab63-0217a66a49d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:00.465817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8cdfa-3dab-42e8-ab63-0217a66a49d8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:00.526528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:00.560117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:00.560727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:00.561003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:00.561272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:00.561920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:38:00.562260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:00.563341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING py.warnings [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:38:00.563341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: warnings.warn(msg) Aug 10 08:38:00.563341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: Aug 10 08:38:00.564230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:00.575554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 745/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:38:00.584139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c63f60-5e18-4613-8d27-1ce607f8efdd None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:00.593751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c63f60-5e18-4613-8d27-1ce607f8efdd None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:00.654353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:00.688002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:00.688596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:00.688867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:00.689128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:00.689767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:00.691495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING py.warnings [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:38:00.691495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: warnings.warn(msg) Aug 10 08:38:00.691495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: Aug 10 08:38:00.692712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:00.808353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 752/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:38:00 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:38:00.812824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:00.814358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:00.847330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd34309-a2f3-4a9c-a22b-d9d18de6525d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:00.942245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:00.942884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:00.943160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:00.943428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:00.944259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:00.945564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING py.warnings [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:38:00.945564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: warnings.warn(msg) Aug 10 08:38:00.945564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: Aug 10 08:38:00.946801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:01.041850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 746/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:38:00 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:38:01.046299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:01.047868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:01.109661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf05c8-3c53-49a0-89ba-d800684a4ebe admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:01.190634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:01.201077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:01.206859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:01.206859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:01.206859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:01.206859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:01.206859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING py.warnings [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:38:01.206859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: warnings.warn(msg) Aug 10 08:38:01.206859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: Aug 10 08:38:01.207550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:01.217183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 753/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:38:01.221220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:01.222773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:01.234954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927098f7-37d3-4004-9274-006c1fb9016d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:01.260366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:01.331252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128e06f-4fb1-40b6-95c5-805db637084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:01.331857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128e06f-4fb1-40b6-95c5-805db637084f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:01.332131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128e06f-4fb1-40b6-95c5-805db637084f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:01.332397 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128e06f-4fb1-40b6-95c5-805db637084f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:01.333034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128e06f-4fb1-40b6-95c5-805db637084f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:01.334047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING py.warnings [None req-2128e06f-4fb1-40b6-95c5-805db637084f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:38:01.334047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: warnings.warn(msg) Aug 10 08:38:01.334047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: Aug 10 08:38:01.334950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128e06f-4fb1-40b6-95c5-805db637084f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:01.348203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 747/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:38:01.353006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:01.354555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:01.387766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6831b9-1fba-4b3c-b785-99291a742f01 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:01.481856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f36e-5eaf-4dbf-aa83-87e5493e852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:01.482534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f36e-5eaf-4dbf-aa83-87e5493e852e admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:01.482813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f36e-5eaf-4dbf-aa83-87e5493e852e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:01.483082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f36e-5eaf-4dbf-aa83-87e5493e852e admin admin] PATH_INFO: `/v3/projects/752ae6128f894d1a9f5c31abe04328ab/users/f36e6971f52045419a34b26b2a9080a5/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:01.504460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f36e-5eaf-4dbf-aa83-87e5493e852e admin admin] RBAC: Authorizing `identity:create_grant(project_id=752ae6128f894d1a9f5c31abe04328ab, user_id=f36e6971f52045419a34b26b2a9080a5, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:01.505478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING py.warnings [None req-43f2f36e-5eaf-4dbf-aa83-87e5493e852e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:38:01.505478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: warnings.warn(msg) Aug 10 08:38:01.505478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: Aug 10 08:38:01.507485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f36e-5eaf-4dbf-aa83-87e5493e852e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:01.615261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 754/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:38:01 2022] PUT /identity/v3/projects/752ae6128f894d1a9f5c31abe04328ab/users/f36e6971f52045419a34b26b2a9080a5/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:38:01.627383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cdf55-f042-4f8a-9874-350c917e5ead None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:01.627666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cdf55-f042-4f8a-9874-350c917e5ead None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:01.627938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cdf55-f042-4f8a-9874-350c917e5ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:01.684366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6b0cdf55-f042-4f8a-9874-350c917e5ead None None] MFA Rules not processed for user `f36e6971f52045419a34b26b2a9080a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:38:01.685615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6b0cdf55-f042-4f8a-9874-350c917e5ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:01.761466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 748/1502] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:38:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:38:01.775199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20830-6a61-4f54-b0c3-c325a18cec1e None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:01.775482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20830-6a61-4f54-b0c3-c325a18cec1e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:01.775751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20830-6a61-4f54-b0c3-c325a18cec1e None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:01.777105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 755/1503] 10.222.0.45 () {54 vars in 964 bytes} [Wed Aug 10 08:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:38:01.781979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94a146-b0fe-4339-88a0-f72f79d8602a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:01.782264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94a146-b0fe-4339-88a0-f72f79d8602a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:01.782571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94a146-b0fe-4339-88a0-f72f79d8602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:01.813067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:01.856572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3a94a146-b0fe-4339-88a0-f72f79d8602a None None] MFA Rules not processed for user `44743b0d10ae4b54920c821e1ef587b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:38:01.857760 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3a94a146-b0fe-4339-88a0-f72f79d8602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:01.932404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 749/1504] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Aug 10 08:38:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:38:01.940205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee20830-6a61-4f54-b0c3-c325a18cec1e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:01.941646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fee20830-6a61-4f54-b0c3-c325a18cec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:01.990359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:02.043203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee20830-6a61-4f54-b0c3-c325a18cec1e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:02.115514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:02.116111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:02.116391 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:02.117147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:02.118765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:02.214440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:02.215820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:02.219232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:02.232977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 756/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:38:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:38:02.278130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521b11-10dd-480f-b525-7559d39a9cfc None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:02.278551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521b11-10dd-480f-b525-7559d39a9cfc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:02.278708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521b11-10dd-480f-b525-7559d39a9cfc None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:02.279981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 750/1506] 10.222.0.45 () {52 vars in 830 bytes} [Wed Aug 10 08:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:38:02.283601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:02.284800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:02.381557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e4b2c-b1dd-4ba9-adc2-5306e6aac286 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:02.473625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:02.474173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:02.474444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:02.474738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] PATH_INFO: `/v3/users/f36e6971f52045419a34b26b2a9080a5` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:02.486776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36e6971f52045419a34b26b2a9080a5)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:02.487798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING py.warnings [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:38:02.487798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: warnings.warn(msg) Aug 10 08:38:02.487798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: Aug 10 08:38:02.489007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:02.498574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:02.691134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36e6971f52045419a34b26b2a9080a5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:02.704874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36e6971f52045419a34b26b2a9080a5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:02.784011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36e6971f52045419a34b26b2a9080a5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:02.784388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36e6971f52045419a34b26b2a9080a5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:02.809358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36e6971f52045419a34b26b2a9080a5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:02.815001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 757/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:38:02 2022] DELETE /identity/v3/users/f36e6971f52045419a34b26b2a9080a5 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:38:02.819519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73336e-fbf9-418c-9499-2dbe26de618a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:02.819826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73336e-fbf9-418c-9499-2dbe26de618a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:02.820109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73336e-fbf9-418c-9499-2dbe26de618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:02.882421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-db73336e-fbf9-418c-9499-2dbe26de618a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:38:02.883798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db73336e-fbf9-418c-9499-2dbe26de618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:02.969924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:02.983092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 751/1508] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:38:02.992584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:02.993838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:03.096631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aac99c-9903-48c1-a092-ddb49f5ca538 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:03.152727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:03.171991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33813c-29bf-42db-a9b7-2d820e21a4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:03.173550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33813c-29bf-42db-a9b7-2d820e21a4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:03.173550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33813c-29bf-42db-a9b7-2d820e21a4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:03.173550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33813c-29bf-42db-a9b7-2d820e21a4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:03.174785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-de33813c-29bf-42db-a9b7-2d820e21a4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:03.324651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33813c-29bf-42db-a9b7-2d820e21a4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:03.326076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33813c-29bf-42db-a9b7-2d820e21a4c9 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:03.344662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 758/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:38:03.860909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73336e-fbf9-418c-9499-2dbe26de618a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:38:03.862171 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db73336e-fbf9-418c-9499-2dbe26de618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:38:03.873995 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73336e-fbf9-418c-9499-2dbe26de618a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:38:03.976870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:38:03.977506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:38:03.977791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:38:03.978088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] PATH_INFO: `/v3/projects/752ae6128f894d1a9f5c31abe04328ab` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:38:03.988471 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=752ae6128f894d1a9f5c31abe04328ab)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:38:03.989506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING py.warnings [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:38:03.989506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: warnings.warn(msg) Aug 10 08:38:03.989506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: Aug 10 08:38:03.990738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:38:04.115289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752ae6128f894d1a9f5c31abe04328ab', 'request_id': 'req-cb52c94b-5d4f-4fae-88b5-c9625046b175'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:04.197863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752ae6128f894d1a9f5c31abe04328ab', 'request_id': 'req-cb52c94b-5d4f-4fae-88b5-c9625046b175'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:04.212805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752ae6128f894d1a9f5c31abe04328ab', 'request_id': 'req-cb52c94b-5d4f-4fae-88b5-c9625046b175'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:04.235622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] The token cache is being invalidate because project 752ae6128f894d1a9f5c31abe04328ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:38:04.235907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:04.236433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb52c94b-5d4f-4fae-88b5-c9625046b175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:38:04.237752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 752/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:38:03 2022] DELETE /identity/v3/projects/752ae6128f894d1a9f5c31abe04328ab => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:38:13.342792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=62 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:38:14.233602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:39:33.463867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82719-4c0c-4dde-be91-229a6fe74290 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:33.464468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82719-4c0c-4dde-be91-229a6fe74290 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:33.464468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82719-4c0c-4dde-be91-229a6fe74290 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:33.465776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:39:33.470559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ec76-cfdb-4016-999e-d13068afc4e0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:33.473193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ec76-cfdb-4016-999e-d13068afc4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:33.473193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ec76-cfdb-4016-999e-d13068afc4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:33.554788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a1c5ec76-cfdb-4016-999e-d13068afc4e0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:33.556049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a1c5ec76-cfdb-4016-999e-d13068afc4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:33.658193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:33.810708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb82719-4c0c-4dde-be91-229a6fe74290 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:39:33.812824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9fb82719-4c0c-4dde-be91-229a6fe74290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:33.929755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb82719-4c0c-4dde-be91-229a6fe74290 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:39:33.935302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6aeac-03e9-4248-90d4-17f1e5a29d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:39:33.935895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6aeac-03e9-4248-90d4-17f1e5a29d5f service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:33.936172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6aeac-03e9-4248-90d4-17f1e5a29d5f service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:33.936436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6aeac-03e9-4248-90d4-17f1e5a29d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:33.945152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6aeac-03e9-4248-90d4-17f1e5a29d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:39:33.946766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6aeac-03e9-4248-90d4-17f1e5a29d5f service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:39:33.956172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 760/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:39:34.781541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5fa60-c6e4-48aa-9ce3-115df004c70e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:34.785346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5fa60-c6e4-48aa-9ce3-115df004c70e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:34.785346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5fa60-c6e4-48aa-9ce3-115df004c70e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:34.785346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:39:34.788113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15aaa1-3b26-46df-b4e0-a51e0f968d33 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:34.788545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15aaa1-3b26-46df-b4e0-a51e0f968d33 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:34.788650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15aaa1-3b26-46df-b4e0-a51e0f968d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:34.808670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7a15aaa1-3b26-46df-b4e0-a51e0f968d33 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:34.809870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7a15aaa1-3b26-46df-b4e0-a51e0f968d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:34.818804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:34.969537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5fa60-c6e4-48aa-9ce3-115df004c70e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:39:34.984135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5fa60-c6e4-48aa-9ce3-115df004c70e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:39:34.989569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0f844-397e-4d62-8acc-86d3fb833a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:39:34.990160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0f844-397e-4d62-8acc-86d3fb833a4d service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:34.990433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0f844-397e-4d62-8acc-86d3fb833a4d service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:34.990734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0f844-397e-4d62-8acc-86d3fb833a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:34.998735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0f844-397e-4d62-8acc-86d3fb833a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:39:35.000954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0f844-397e-4d62-8acc-86d3fb833a4d service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:39:35.010185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 755/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:39:35.298494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b318-9e92-4c3a-95d6-9f1a95024795 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:35.298699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b318-9e92-4c3a-95d6-9f1a95024795 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:35.298958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5b318-9e92-4c3a-95d6-9f1a95024795 None None] PATH_INFO: `/v3` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:35.300366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 762/1517] 10.222.0.62 () {54 vars in 925 bytes} [Wed Aug 10 08:39:35 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:39:35.307008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce506-3e9f-43d9-8ec6-ed81d4d4885b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:35.307296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce506-3e9f-43d9-8ec6-ed81d4d4885b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:35.307572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce506-3e9f-43d9-8ec6-ed81d4d4885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:35.365824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a95ce506-3e9f-43d9-8ec6-ed81d4d4885b None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:35.367083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a95ce506-3e9f-43d9-8ec6-ed81d4d4885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:35.383401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:39:35.437685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 756/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Aug 10 08:39:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:44.634117 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60faa07-d9d1-49b6-99ff-618c2bc0bfdf None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:44.634679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60faa07-d9d1-49b6-99ff-618c2bc0bfdf None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:44.634679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60faa07-d9d1-49b6-99ff-618c2bc0bfdf None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:44.635933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 763/1519] 10.222.0.45 () {54 vars in 961 bytes} [Wed Aug 10 08:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:39:44.640753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063aede-8386-40cc-ac46-85fea70fbfbc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:44.641718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063aede-8386-40cc-ac46-85fea70fbfbc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:44.641827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063aede-8386-40cc-ac46-85fea70fbfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:44.661236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9063aede-8386-40cc-ac46-85fea70fbfbc None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:44.662409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9063aede-8386-40cc-ac46-85fea70fbfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:44.671066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 757/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Aug 10 08:39:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:44.678323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60faa07-d9d1-49b6-99ff-618c2bc0bfdf None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:39:44.691299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60faa07-d9d1-49b6-99ff-618c2bc0bfdf None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:39:44.696178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875d8d8-29ec-4fff-b438-1af6bc5e03ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:39:44.696748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875d8d8-29ec-4fff-b438-1af6bc5e03ce service placement] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:44.697022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875d8d8-29ec-4fff-b438-1af6bc5e03ce service placement] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:44.697298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875d8d8-29ec-4fff-b438-1af6bc5e03ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:44.705975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875d8d8-29ec-4fff-b438-1af6bc5e03ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:39:44.707569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875d8d8-29ec-4fff-b438-1af6bc5e03ce service placement] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:39:44.717141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 764/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:39:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:39:46.231125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee36f03-3ccf-436e-a9c8-ca8b6c1df9e1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:46.231668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee36f03-3ccf-436e-a9c8-ca8b6c1df9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:46.231668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee36f03-3ccf-436e-a9c8-ca8b6c1df9e1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:46.232924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:39:46.238081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5d8b-3983-4b3a-b6e2-07bf14085670 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:46.238514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5d8b-3983-4b3a-b6e2-07bf14085670 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:46.238665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5d8b-3983-4b3a-b6e2-07bf14085670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:46.258560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-207d5d8b-3983-4b3a-b6e2-07bf14085670 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:46.259796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-207d5d8b-3983-4b3a-b6e2-07bf14085670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:46.267722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:46.419897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee36f03-3ccf-436e-a9c8-ca8b6c1df9e1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:39:46.434674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee36f03-3ccf-436e-a9c8-ca8b6c1df9e1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:39:46.440221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96b44-fa56-4b8c-aed1-295cd938009d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:39:46.440817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96b44-fa56-4b8c-aed1-295cd938009d service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:46.441083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96b44-fa56-4b8c-aed1-295cd938009d service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:46.441353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96b44-fa56-4b8c-aed1-295cd938009d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:46.449374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96b44-fa56-4b8c-aed1-295cd938009d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:39:46.451050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96b44-fa56-4b8c-aed1-295cd938009d service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:39:46.460419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 759/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:39:47.279393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c00b1-cde3-43d2-8579-d739aaf368b6 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:47.279920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c00b1-cde3-43d2-8579-d739aaf368b6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:47.279920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c00b1-cde3-43d2-8579-d739aaf368b6 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:47.281409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 08:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:39:47.286240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32db39-6497-43ba-9a52-101e550559c7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:47.286668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32db39-6497-43ba-9a52-101e550559c7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:47.286795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32db39-6497-43ba-9a52-101e550559c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:47.305932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bf32db39-6497-43ba-9a52-101e550559c7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:47.307142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf32db39-6497-43ba-9a52-101e550559c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:47.315402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 08:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:47.465434 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c00b1-cde3-43d2-8579-d739aaf368b6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:39:47.479462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c00b1-cde3-43d2-8579-d739aaf368b6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:39:47.484813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1293a-6e3c-46a7-b093-dae0386f9f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:39:47.485394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1293a-6e3c-46a7-b093-dae0386f9f00 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:47.485668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1293a-6e3c-46a7-b093-dae0386f9f00 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:47.485934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1293a-6e3c-46a7-b093-dae0386f9f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:47.493616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1293a-6e3c-46a7-b093-dae0386f9f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:39:47.495216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1293a-6e3c-46a7-b093-dae0386f9f00 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:39:47.504809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 767/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:39:51.395442 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cacbd-9f72-4add-b56b-ccbe6e3bfee5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:51.395990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cacbd-9f72-4add-b56b-ccbe6e3bfee5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:51.395990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cacbd-9f72-4add-b56b-ccbe6e3bfee5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:51.397295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:39:51.402596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff695-f7a5-4075-8691-176a02aca40d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:51.403031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff695-f7a5-4075-8691-176a02aca40d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:51.403168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff695-f7a5-4075-8691-176a02aca40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:51.422997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4f8ff695-f7a5-4075-8691-176a02aca40d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:51.424195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4f8ff695-f7a5-4075-8691-176a02aca40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:51.432061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:51.505796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cacbd-9f72-4add-b56b-ccbe6e3bfee5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:39:51.507762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-034cacbd-9f72-4add-b56b-ccbe6e3bfee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:51.593534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cacbd-9f72-4add-b56b-ccbe6e3bfee5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:39:51.597706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2572d-8946-474b-9307-07ca40d4897e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:39:51.598297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2572d-8946-474b-9307-07ca40d4897e service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:51.598600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2572d-8946-474b-9307-07ca40d4897e service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:51.598866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2572d-8946-474b-9307-07ca40d4897e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:51.607477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2572d-8946-474b-9307-07ca40d4897e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:39:51.608884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2572d-8946-474b-9307-07ca40d4897e service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:39:51.617953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 762/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:39:53.587735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fbf9-2afc-4a28-af16-50160a6e7ad5 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:53.588278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fbf9-2afc-4a28-af16-50160a6e7ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:53.588278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fbf9-2afc-4a28-af16-50160a6e7ad5 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:53.589613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:39:53.595309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e02b98-d463-4d8e-9613-187b2650dcbc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:53.595735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e02b98-d463-4d8e-9613-187b2650dcbc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:53.595850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e02b98-d463-4d8e-9613-187b2650dcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:53.614719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-39e02b98-d463-4d8e-9613-187b2650dcbc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:53.615909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-39e02b98-d463-4d8e-9613-187b2650dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:53.623636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:53.659711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059fbf9-2afc-4a28-af16-50160a6e7ad5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:39:53.674246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059fbf9-2afc-4a28-af16-50160a6e7ad5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:39:53.677857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8883d4-84af-450c-9a7e-b6b633cb8411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:39:53.678490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8883d4-84af-450c-9a7e-b6b633cb8411 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:53.678781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8883d4-84af-450c-9a7e-b6b633cb8411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:53.679049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8883d4-84af-450c-9a7e-b6b633cb8411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:53.688065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8883d4-84af-450c-9a7e-b6b633cb8411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:39:53.691986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8883d4-84af-450c-9a7e-b6b633cb8411 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:39:53.698744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 770/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:39:57.262896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7205f4-667e-4340-bcbc-0a72fb23b8a2 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:57.263427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7205f4-667e-4340-bcbc-0a72fb23b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:57.263427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7205f4-667e-4340-bcbc-0a72fb23b8a2 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:57.264705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:39:57.270285 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8114-4159-499c-9d2b-117d999fb0af None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:57.270721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8114-4159-499c-9d2b-117d999fb0af None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:57.270864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8114-4159-499c-9d2b-117d999fb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:57.290801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b9fc8114-4159-499c-9d2b-117d999fb0af None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:57.292021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b9fc8114-4159-499c-9d2b-117d999fb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:57.299887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:39:57.599955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7205f4-667e-4340-bcbc-0a72fb23b8a2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:39:57.601608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-be7205f4-667e-4340-bcbc-0a72fb23b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:57.665515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:39:57.678322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7205f4-667e-4340-bcbc-0a72fb23b8a2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:39:57.681937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6862ae-8339-4811-8804-6c26998c7047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:39:57.682558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6862ae-8339-4811-8804-6c26998c7047 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:57.682836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6862ae-8339-4811-8804-6c26998c7047 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:57.683104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6862ae-8339-4811-8804-6c26998c7047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:57.692232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6862ae-8339-4811-8804-6c26998c7047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:39:57.693654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6862ae-8339-4811-8804-6c26998c7047 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:39:57.703875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 765/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:39:59.688258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef07672-d960-47c8-ba64-bdab1e319814 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:59.688837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef07672-d960-47c8-ba64-bdab1e319814 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:59.688837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef07672-d960-47c8-ba64-bdab1e319814 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:59.690822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 08:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:39:59.695871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbe5b-beb9-493d-9952-3814d56774f6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:39:59.696301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbe5b-beb9-493d-9952-3814d56774f6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:39:59.696408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbe5b-beb9-493d-9952-3814d56774f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:39:59.716573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a4cdbe5b-beb9-493d-9952-3814d56774f6 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:39:59.717761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a4cdbe5b-beb9-493d-9952-3814d56774f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:39:59.725612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 08:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:40:00.027667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef07672-d960-47c8-ba64-bdab1e319814 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:40:00.029321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2ef07672-d960-47c8-ba64-bdab1e319814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:40:00.042787 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef07672-d960-47c8-ba64-bdab1e319814 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:40:00.046250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24036af-0584-4d2a-ad41-d75222b0e21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:40:00.047512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24036af-0584-4d2a-ad41-d75222b0e21b service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:40:00.047788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24036af-0584-4d2a-ad41-d75222b0e21b service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:40:00.048058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24036af-0584-4d2a-ad41-d75222b0e21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:40:00.056736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24036af-0584-4d2a-ad41-d75222b0e21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:40:00.058142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24036af-0584-4d2a-ad41-d75222b0e21b service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:40:00.067434 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 773/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:40:09.711611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=11 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:40:10.063412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:23.813724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23f7f3-512e-495f-9e02-a408ed105c8c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:23.814371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23f7f3-512e-495f-9e02-a408ed105c8c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:23.814371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23f7f3-512e-495f-9e02-a408ed105c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:23.842974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2a23f7f3-512e-495f-9e02-a408ed105c8c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:23.844577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2a23f7f3-512e-495f-9e02-a408ed105c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:23.857528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 767/1540] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:23.867407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8672-eb16-41fd-ad83-9128148c4321 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:23.868002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8672-eb16-41fd-ad83-9128148c4321 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:23.868002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8672-eb16-41fd-ad83-9128148c4321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:23.903039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bf5f8672-eb16-41fd-ad83-9128148c4321 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:23.910176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bf5f8672-eb16-41fd-ad83-9128148c4321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:23.917223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 774/1541] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:23.928383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23f7f3-512e-495f-9e02-a408ed105c8c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:23.954658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23f7f3-512e-495f-9e02-a408ed105c8c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:23.962980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:23.964029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:23.964527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:23.965027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:23.965937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:23.966556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:23.968506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:23.987013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 768/1542] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:23.989205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1d0c-5491-4a35-acf3-b1b47d22b280 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:23.989499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1d0c-5491-4a35-acf3-b1b47d22b280 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:23.989777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1d0c-5491-4a35-acf3-b1b47d22b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:23.996266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.011477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a10c-c6ae-46b2-b89e-9c066e8a1cee admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.021551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b1774-2544-44b6-b3c7-d5c375acad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.022525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1774-2544-44b6-b3c7-d5c375acad09 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.023028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1774-2544-44b6-b3c7-d5c375acad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.023535 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b1774-2544-44b6-b3c7-d5c375acad09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.024377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b1774-2544-44b6-b3c7-d5c375acad09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.025674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING py.warnings [None req-3a2b1774-2544-44b6-b3c7-d5c375acad09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:41:24.025674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: warnings.warn(msg) Aug 10 08:41:24.025674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: Aug 10 08:41:24.027454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b1774-2544-44b6-b3c7-d5c375acad09 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.034501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d28e1d0c-5491-4a35-acf3-b1b47d22b280 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.034501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d28e1d0c-5491-4a35-acf3-b1b47d22b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.049557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 775/1543] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.059226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb44b-66cf-4075-9551-fc7edd6cc017 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.059565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb44b-66cf-4075-9551-fc7edd6cc017 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.059787 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bb44b-66cf-4075-9551-fc7edd6cc017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.100358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d74bb44b-66cf-4075-9551-fc7edd6cc017 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.101596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d74bb44b-66cf-4075-9551-fc7edd6cc017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.115125 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 776/1544] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.116491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc88bbe-7fc7-48a7-8dfe-ea112e7938cc None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.116777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc88bbe-7fc7-48a7-8dfe-ea112e7938cc None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.117052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc88bbe-7fc7-48a7-8dfe-ea112e7938cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.149850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-0bc88bbe-7fc7-48a7-8dfe-ea112e7938cc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.151204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0bc88bbe-7fc7-48a7-8dfe-ea112e7938cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.164087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 777/1545] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.165070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc88bbe-7fc7-48a7-8dfe-ea112e7938cc None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.176970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 769/1546] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:23 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:41:24.178342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc88bbe-7fc7-48a7-8dfe-ea112e7938cc None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.184602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1d4a-f180-4d68-9ea2-a755e4cc0e6e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.185916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1d4a-f180-4d68-9ea2-a755e4cc0e6e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.186421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1d4a-f180-4d68-9ea2-a755e4cc0e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.215637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a2ac1d4a-f180-4d68-9ea2-a755e4cc0e6e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.217254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a2ac1d4a-f180-4d68-9ea2-a755e4cc0e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.269397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.270026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.270330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.270668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.271332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:24.271633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.272657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING py.warnings [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:41:24.272657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: warnings.warn(msg) Aug 10 08:41:24.272657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: Aug 10 08:41:24.273869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.288396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 778/1547] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:24.289357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.298775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 770/1548] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.299551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de371fb-67a5-4a65-b98a-b7381bbad358 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.300077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e25d0-798e-40c1-997d-b80a13a102c2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.300308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e25d0-798e-40c1-997d-b80a13a102c2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.300579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e25d0-798e-40c1-997d-b80a13a102c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.306694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8168d5-ad19-4d0e-b464-6e3e255ebf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.307292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8168d5-ad19-4d0e-b464-6e3e255ebf1b admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.307573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8168d5-ad19-4d0e-b464-6e3e255ebf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.307845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8168d5-ad19-4d0e-b464-6e3e255ebf1b admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.308461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8168d5-ad19-4d0e-b464-6e3e255ebf1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.309474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING py.warnings [None req-6e8168d5-ad19-4d0e-b464-6e3e255ebf1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:41:24.309474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: warnings.warn(msg) Aug 10 08:41:24.309474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: Aug 10 08:41:24.310695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8168d5-ad19-4d0e-b464-6e3e255ebf1b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.320837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a02e25d0-798e-40c1-997d-b80a13a102c2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.322033 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a02e25d0-798e-40c1-997d-b80a13a102c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.329945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 771/1549] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.331132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565cc98-9524-4fa1-8751-1698cd4634a9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.336269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565cc98-9524-4fa1-8751-1698cd4634a9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.336269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565cc98-9524-4fa1-8751-1698cd4634a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.350696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c565cc98-9524-4fa1-8751-1698cd4634a9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.351934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c565cc98-9524-4fa1-8751-1698cd4634a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.360010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 772/1550] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.361140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f03fad-2822-4915-94a8-35bc4af1c567 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.361417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f03fad-2822-4915-94a8-35bc4af1c567 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.361683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f03fad-2822-4915-94a8-35bc4af1c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.381087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e5f03fad-2822-4915-94a8-35bc4af1c567 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.382233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e5f03fad-2822-4915-94a8-35bc4af1c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.388398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 779/1551] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:24.393661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddde9c2-ce01-4d1d-93a3-c4859695eae0 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.393661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddde9c2-ce01-4d1d-93a3-c4859695eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.393661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddde9c2-ce01-4d1d-93a3-c4859695eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.393957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 773/1552] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.393957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de1b93-e84b-431b-8f0c-4ab60c2adeb3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.393957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de1b93-e84b-431b-8f0c-4ab60c2adeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.393957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de1b93-e84b-431b-8f0c-4ab60c2adeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.417276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4ddde9c2-ce01-4d1d-93a3-c4859695eae0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.417623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b2de1b93-e84b-431b-8f0c-4ab60c2adeb3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.418510 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4ddde9c2-ce01-4d1d-93a3-c4859695eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.418809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b2de1b93-e84b-431b-8f0c-4ab60c2adeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.426976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 780/1553] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.427138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 774/1554] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.427796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de1b93-e84b-431b-8f0c-4ab60c2adeb3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.427943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddde9c2-ce01-4d1d-93a3-c4859695eae0 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.440104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddde9c2-ce01-4d1d-93a3-c4859695eae0 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.440731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de1b93-e84b-431b-8f0c-4ab60c2adeb3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.445959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535819f-a2d2-47c8-8b79-abe50ce50e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.446148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee4bab-defc-4f4f-888f-8bad11f2e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.446589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535819f-a2d2-47c8-8b79-abe50ce50e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.446694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4bab-defc-4f4f-888f-8bad11f2e148 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.446870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535819f-a2d2-47c8-8b79-abe50ce50e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.446992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4bab-defc-4f4f-888f-8bad11f2e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.447144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4bab-defc-4f4f-888f-8bad11f2e148 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.447242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535819f-a2d2-47c8-8b79-abe50ce50e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.447793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4bab-defc-4f4f-888f-8bad11f2e148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:24.447898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535819f-a2d2-47c8-8b79-abe50ce50e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.448090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4bab-defc-4f4f-888f-8bad11f2e148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.449668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4bab-defc-4f4f-888f-8bad11f2e148 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.449775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535819f-a2d2-47c8-8b79-abe50ce50e81 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.461150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 775/1555] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:24.462314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a72e-46ee-4593-82a8-6ac68d0a4838 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.462633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a72e-46ee-4593-82a8-6ac68d0a4838 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.462905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a72e-46ee-4593-82a8-6ac68d0a4838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.481920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-79c2a72e-46ee-4593-82a8-6ac68d0a4838 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.483131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-79c2a72e-46ee-4593-82a8-6ac68d0a4838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.491563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 776/1556] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.492758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a3ece-100d-455c-83a8-1ac6c1389b43 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.493038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a3ece-100d-455c-83a8-1ac6c1389b43 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.493307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a3ece-100d-455c-83a8-1ac6c1389b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.511297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-471a3ece-100d-455c-83a8-1ac6c1389b43 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.512552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-471a3ece-100d-455c-83a8-1ac6c1389b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.520166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 777/1557] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.520897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a3ece-100d-455c-83a8-1ac6c1389b43 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.530136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a3ece-100d-455c-83a8-1ac6c1389b43 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.534663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9515cdd-a6d9-4df6-a4c9-48c6d909343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.537275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515cdd-a6d9-4df6-a4c9-48c6d909343b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.537275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515cdd-a6d9-4df6-a4c9-48c6d909343b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.537275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515cdd-a6d9-4df6-a4c9-48c6d909343b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.537275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9515cdd-a6d9-4df6-a4c9-48c6d909343b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.538857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9515cdd-a6d9-4df6-a4c9-48c6d909343b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.548652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 778/1558] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:24.549759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8707-f918-4fc0-af3b-9cb83f99a4e9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.550041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8707-f918-4fc0-af3b-9cb83f99a4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.550359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8707-f918-4fc0-af3b-9cb83f99a4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.556310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 781/1559] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:24.560465 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba6db-bf85-4d9c-a57d-316c9171cab9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.560896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba6db-bf85-4d9c-a57d-316c9171cab9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.561176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba6db-bf85-4d9c-a57d-316c9171cab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.569538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-32fc8707-f918-4fc0-af3b-9cb83f99a4e9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.571753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-32fc8707-f918-4fc0-af3b-9cb83f99a4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.580085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d30ba6db-bf85-4d9c-a57d-316c9171cab9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.581268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d30ba6db-bf85-4d9c-a57d-316c9171cab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.614805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:24.631665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 779/1560] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.632996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90871e5-f590-4159-8b26-ab3e3d1c9f80 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.633278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90871e5-f590-4159-8b26-ab3e3d1c9f80 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.633563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90871e5-f590-4159-8b26-ab3e3d1c9f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.640755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 782/1561] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.641750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ba6db-bf85-4d9c-a57d-316c9171cab9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.651026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ba6db-bf85-4d9c-a57d-316c9171cab9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.654435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a90871e5-f590-4159-8b26-ab3e3d1c9f80 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:24.655649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a90871e5-f590-4159-8b26-ab3e3d1c9f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:24.655789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf038815-3435-4e31-8b28-62180f5a7313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.656377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038815-3435-4e31-8b28-62180f5a7313 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.656656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038815-3435-4e31-8b28-62180f5a7313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.656921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038815-3435-4e31-8b28-62180f5a7313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.657529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf038815-3435-4e31-8b28-62180f5a7313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.659461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf038815-3435-4e31-8b28-62180f5a7313 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.664373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 780/1562] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:24.668310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90871e5-f590-4159-8b26-ab3e3d1c9f80 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.674356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90871e5-f590-4159-8b26-ab3e3d1c9f80 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.680645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.681274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.681553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.681870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.682620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:24.682928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.684632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.696110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 781/1563] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:24.696886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.707544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee06cb-643c-4a49-98e3-e9c839c11114 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.712095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.712653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.712932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.713204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.713830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:24.714130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.715727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.727744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 782/1564] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:24.728499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.737623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb7859-42ef-4e16-b68d-2cfd87b1c0a0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.742873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81f7b4-7de6-4f98-9e89-353f995d1c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.743433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f7b4-7de6-4f98-9e89-353f995d1c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.743714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f7b4-7de6-4f98-9e89-353f995d1c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.743985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81f7b4-7de6-4f98-9e89-353f995d1c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.744606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81f7b4-7de6-4f98-9e89-353f995d1c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.746129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81f7b4-7de6-4f98-9e89-353f995d1c89 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.749059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:24.756207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 783/1565] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:24.756354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 783/1566] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:24.756761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81f7b4-7de6-4f98-9e89-353f995d1c89 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.756974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf038815-3435-4e31-8b28-62180f5a7313 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.766632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81f7b4-7de6-4f98-9e89-353f995d1c89 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.819888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf038815-3435-4e31-8b28-62180f5a7313 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.824604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.825209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.825489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.825602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ccb8f-1339-48bd-9e72-05a0dad78089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.826089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.826259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ccb8f-1339-48bd-9e72-05a0dad78089 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.826395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:24.826566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ccb8f-1339-48bd-9e72-05a0dad78089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.826729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.826847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ccb8f-1339-48bd-9e72-05a0dad78089 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.827432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ccb8f-1339-48bd-9e72-05a0dad78089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.828323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.829341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ccb8f-1339-48bd-9e72-05a0dad78089 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.840473 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 784/1567] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:24.841647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.851629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae8e0-d21c-493e-90b6-29a144829f6f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.857229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.859048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.859048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.859048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.859048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:24.859397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.860981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.873170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 785/1568] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:24.874152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.884094 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56c96-0b71-42d7-8007-6ff5212b24bb admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.888800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.889393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.889670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.889939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.890618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:24.890921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.892505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.912849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 786/1569] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:24.912849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.915932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9649e-6315-4ab6-8dff-20b1308c29ed admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.920590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a3f68-7a19-442d-a9d6-d21138ee23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.921162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a3f68-7a19-442d-a9d6-d21138ee23c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.921438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a3f68-7a19-442d-a9d6-d21138ee23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.921743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a3f68-7a19-442d-a9d6-d21138ee23c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.922381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a3f68-7a19-442d-a9d6-d21138ee23c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.924320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a3f68-7a19-442d-a9d6-d21138ee23c0 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:24.938444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 784/1570] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:24.938444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ccb8f-1339-48bd-9e72-05a0dad78089 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:24.951007 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ccb8f-1339-48bd-9e72-05a0dad78089 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:24.956066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90a37-5d02-4a92-8040-52c350cbbb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:24.957534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90a37-5d02-4a92-8040-52c350cbbb1a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:24.957857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90a37-5d02-4a92-8040-52c350cbbb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:24.958126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90a37-5d02-4a92-8040-52c350cbbb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:24.958775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd90a37-5d02-4a92-8040-52c350cbbb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:24.960685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd90a37-5d02-4a92-8040-52c350cbbb1a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.017857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 787/1571] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.018698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a3f68-7a19-442d-a9d6-d21138ee23c0 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.052610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 785/1572] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:24 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.053261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90a37-5d02-4a92-8040-52c350cbbb1a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.084951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a3f68-7a19-442d-a9d6-d21138ee23c0 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.118102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90a37-5d02-4a92-8040-52c350cbbb1a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.124038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6055e-9222-4f85-8287-7955167b4017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.125148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6055e-9222-4f85-8287-7955167b4017 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.125148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6055e-9222-4f85-8287-7955167b4017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.125148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6055e-9222-4f85-8287-7955167b4017 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.125782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6055e-9222-4f85-8287-7955167b4017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.127747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6055e-9222-4f85-8287-7955167b4017 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.128640 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:25.137302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f138e2d-894d-4a8c-a41b-8b03ed54a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.137993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138e2d-894d-4a8c-a41b-8b03ed54a641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.138271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138e2d-894d-4a8c-a41b-8b03ed54a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.142526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138e2d-894d-4a8c-a41b-8b03ed54a641 admin admin] PATH_INFO: `/v3/projects/be3bd9804f144d64aa4984a3ba0e6e2b/users/527fdf5cf2af40c893b0e4ef9dc4e486/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.154227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f138e2d-894d-4a8c-a41b-8b03ed54a641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3bd9804f144d64aa4984a3ba0e6e2b, user_id=527fdf5cf2af40c893b0e4ef9dc4e486, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.157011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f138e2d-894d-4a8c-a41b-8b03ed54a641 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.183263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:25.188403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 786/1573] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.189242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6055e-9222-4f85-8287-7955167b4017 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.200036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6055e-9222-4f85-8287-7955167b4017 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.204624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553f7c7-356d-4dbb-be6f-1933e4457462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.205220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553f7c7-356d-4dbb-be6f-1933e4457462 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.205494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553f7c7-356d-4dbb-be6f-1933e4457462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.205761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553f7c7-356d-4dbb-be6f-1933e4457462 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.206413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553f7c7-356d-4dbb-be6f-1933e4457462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.208963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553f7c7-356d-4dbb-be6f-1933e4457462 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.222767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 788/1574] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:25 2022] PUT /identity/v3/projects/be3bd9804f144d64aa4984a3ba0e6e2b/users/527fdf5cf2af40c893b0e4ef9dc4e486/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:25.223613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f138e2d-894d-4a8c-a41b-8b03ed54a641 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.286411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f138e2d-894d-4a8c-a41b-8b03ed54a641 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.291532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8064a8-6888-4645-9619-39d15ae12b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.292120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8064a8-6888-4645-9619-39d15ae12b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.292393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8064a8-6888-4645-9619-39d15ae12b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.292658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8064a8-6888-4645-9619-39d15ae12b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.293272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8064a8-6888-4645-9619-39d15ae12b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.295307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8064a8-6888-4645-9619-39d15ae12b9b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.332895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 787/1575] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.333773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553f7c7-356d-4dbb-be6f-1933e4457462 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.392307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553f7c7-356d-4dbb-be6f-1933e4457462 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.399140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 789/1576] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.399140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8064a8-6888-4645-9619-39d15ae12b9b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.401749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d709-ca12-4d6a-9c87-b4f778545cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.402355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d709-ca12-4d6a-9c87-b4f778545cae admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.402653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d709-ca12-4d6a-9c87-b4f778545cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.402923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6d709-ca12-4d6a-9c87-b4f778545cae admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.403613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6d709-ca12-4d6a-9c87-b4f778545cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.405514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6d709-ca12-4d6a-9c87-b4f778545cae admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.458858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8064a8-6888-4645-9619-39d15ae12b9b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.463569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af46d7-622d-4c91-96a6-1599f77f2cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.464171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af46d7-622d-4c91-96a6-1599f77f2cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.464449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af46d7-622d-4c91-96a6-1599f77f2cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.464722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af46d7-622d-4c91-96a6-1599f77f2cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.465360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af46d7-622d-4c91-96a6-1599f77f2cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.467048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af46d7-622d-4c91-96a6-1599f77f2cc4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.476769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 790/1577] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:25.477532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af46d7-622d-4c91-96a6-1599f77f2cc4 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.481882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 788/1578] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.481882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d709-ca12-4d6a-9c87-b4f778545cae admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.491511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af46d7-622d-4c91-96a6-1599f77f2cc4 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.543279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:25.544767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6d709-ca12-4d6a-9c87-b4f778545cae admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.549173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565000a6-3d34-4685-a088-7043a8eb925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.549467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6404f31-7e94-43f1-8787-6e44df045d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.554384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565000a6-3d34-4685-a088-7043a8eb925a admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.554521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404f31-7e94-43f1-8787-6e44df045d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.554629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565000a6-3d34-4685-a088-7043a8eb925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.554720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404f31-7e94-43f1-8787-6e44df045d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.554814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565000a6-3d34-4685-a088-7043a8eb925a admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.554920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404f31-7e94-43f1-8787-6e44df045d31 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.555018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565000a6-3d34-4685-a088-7043a8eb925a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.555116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6404f31-7e94-43f1-8787-6e44df045d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.555211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565000a6-3d34-4685-a088-7043a8eb925a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.555299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6404f31-7e94-43f1-8787-6e44df045d31 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.679060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 791/1579] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.686247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565000a6-3d34-4685-a088-7043a8eb925a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.688946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565000a6-3d34-4685-a088-7043a8eb925a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.694151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3c19b-ec25-4b05-9921-20afd1b0cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.694744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3c19b-ec25-4b05-9921-20afd1b0cb13 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.695017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3c19b-ec25-4b05-9921-20afd1b0cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.695283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3c19b-ec25-4b05-9921-20afd1b0cb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.695901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3c19b-ec25-4b05-9921-20afd1b0cb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.697457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3c19b-ec25-4b05-9921-20afd1b0cb13 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.707641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 789/1580] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.718508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 792/1581] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:25.718655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a834cf-347d-44fd-a328-287896850759 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.718775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3c19b-ec25-4b05-9921-20afd1b0cb13 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.718885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a834cf-347d-44fd-a328-287896850759 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.718885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a834cf-347d-44fd-a328-287896850759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.723074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3c19b-ec25-4b05-9921-20afd1b0cb13 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.728400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19533402-1876-4e68-8d81-5f1dd64555e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.729042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533402-1876-4e68-8d81-5f1dd64555e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.729175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-82a834cf-347d-44fd-a328-287896850759 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:25.729345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533402-1876-4e68-8d81-5f1dd64555e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.729588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533402-1876-4e68-8d81-5f1dd64555e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.730203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19533402-1876-4e68-8d81-5f1dd64555e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.730330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-82a834cf-347d-44fd-a328-287896850759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:25.732270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19533402-1876-4e68-8d81-5f1dd64555e7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.737796 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 790/1582] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:25.738608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a834cf-347d-44fd-a328-287896850759 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.751579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a834cf-347d-44fd-a328-287896850759 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.757103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25596bc-fc1a-4f7a-8721-f40da3dfac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.757715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25596bc-fc1a-4f7a-8721-f40da3dfac12 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.757994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25596bc-fc1a-4f7a-8721-f40da3dfac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.758267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25596bc-fc1a-4f7a-8721-f40da3dfac12 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.758919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25596bc-fc1a-4f7a-8721-f40da3dfac12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.760842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25596bc-fc1a-4f7a-8721-f40da3dfac12 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.808449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 793/1583] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.808449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19533402-1876-4e68-8d81-5f1dd64555e7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.816671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19533402-1876-4e68-8d81-5f1dd64555e7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.821986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3212f3-2ef5-4dbd-98a5-7c8022ec0849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.822599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3212f3-2ef5-4dbd-98a5-7c8022ec0849 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.822999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3212f3-2ef5-4dbd-98a5-7c8022ec0849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.823187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3212f3-2ef5-4dbd-98a5-7c8022ec0849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.823823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3212f3-2ef5-4dbd-98a5-7c8022ec0849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.825414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3212f3-2ef5-4dbd-98a5-7c8022ec0849 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.832410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 791/1584] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.832410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25596bc-fc1a-4f7a-8721-f40da3dfac12 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.841316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 794/1585] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:25.841316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3212f3-2ef5-4dbd-98a5-7c8022ec0849 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.841555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25596bc-fc1a-4f7a-8721-f40da3dfac12 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.844770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc8eb7-ee9f-460e-9ce6-73bcf91cd913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.845367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc8eb7-ee9f-460e-9ce6-73bcf91cd913 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.845639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc8eb7-ee9f-460e-9ce6-73bcf91cd913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.845911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc8eb7-ee9f-460e-9ce6-73bcf91cd913 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.846549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc8eb7-ee9f-460e-9ce6-73bcf91cd913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.848438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc8eb7-ee9f-460e-9ce6-73bcf91cd913 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.849144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3212f3-2ef5-4dbd-98a5-7c8022ec0849 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.853729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1637b5-2163-4600-b936-ab1c008b1254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.856846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1637b5-2163-4600-b936-ab1c008b1254 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.856846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1637b5-2163-4600-b936-ab1c008b1254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.856846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1637b5-2163-4600-b936-ab1c008b1254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.856846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1637b5-2163-4600-b936-ab1c008b1254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.857232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1637b5-2163-4600-b936-ab1c008b1254 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.868060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 795/1586] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:25.868861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1637b5-2163-4600-b936-ab1c008b1254 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.878130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1637b5-2163-4600-b936-ab1c008b1254 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.883302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a783-627c-45c4-8d88-b4607e33f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.883861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a783-627c-45c4-8d88-b4607e33f78c admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.884134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a783-627c-45c4-8d88-b4607e33f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.884397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a783-627c-45c4-8d88-b4607e33f78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.885713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a783-627c-45c4-8d88-b4607e33f78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.886582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a783-627c-45c4-8d88-b4607e33f78c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.896495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 796/1587] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:25.897413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a783-627c-45c4-8d88-b4607e33f78c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.902748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 792/1588] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:25 2022] POST /identity/v3/users => generated 297 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:25.903853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc8eb7-ee9f-460e-9ce6-73bcf91cd913 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.907267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a783-627c-45c4-8d88-b4607e33f78c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.912757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955de2f9-961c-4336-b9c1-5e5ef4cb4c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.920383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955de2f9-961c-4336-b9c1-5e5ef4cb4c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.920383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955de2f9-961c-4336-b9c1-5e5ef4cb4c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.920383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955de2f9-961c-4336-b9c1-5e5ef4cb4c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.920383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955de2f9-961c-4336-b9c1-5e5ef4cb4c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.920383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955de2f9-961c-4336-b9c1-5e5ef4cb4c13 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.920843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:25.928355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 797/1589] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:25.929891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955de2f9-961c-4336-b9c1-5e5ef4cb4c13 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.941589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955de2f9-961c-4336-b9c1-5e5ef4cb4c13 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.946799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f288e7d-1b1b-46d8-8730-88ecc106336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.947402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288e7d-1b1b-46d8-8730-88ecc106336b admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.947680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288e7d-1b1b-46d8-8730-88ecc106336b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.947952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288e7d-1b1b-46d8-8730-88ecc106336b admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.948592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f288e7d-1b1b-46d8-8730-88ecc106336b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.950179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f288e7d-1b1b-46d8-8730-88ecc106336b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.960908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 798/1590] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:25.961781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f288e7d-1b1b-46d8-8730-88ecc106336b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.968656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc8eb7-ee9f-460e-9ce6-73bcf91cd913 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.971912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f288e7d-1b1b-46d8-8730-88ecc106336b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:25.972484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea134d-555e-4ae9-b57b-adeed4aa9e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.973730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea134d-555e-4ae9-b57b-adeed4aa9e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.974009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea134d-555e-4ae9-b57b-adeed4aa9e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.974276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea134d-555e-4ae9-b57b-adeed4aa9e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.978559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211f701-e29e-4aaf-a591-80d4a67292a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:25.979138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f701-e29e-4aaf-a591-80d4a67292a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:25.979411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f701-e29e-4aaf-a591-80d4a67292a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:25.979676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f701-e29e-4aaf-a591-80d4a67292a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:25.980299 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211f701-e29e-4aaf-a591-80d4a67292a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.981869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211f701-e29e-4aaf-a591-80d4a67292a9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.984311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea134d-555e-4ae9-b57b-adeed4aa9e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:25.985734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea134d-555e-4ae9-b57b-adeed4aa9e18 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:25.992311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 799/1591] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:25.993102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211f701-e29e-4aaf-a591-80d4a67292a9 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:25.996113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 793/1592] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:25.996905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea134d-555e-4ae9-b57b-adeed4aa9e18 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.002713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211f701-e29e-4aaf-a591-80d4a67292a9 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.007993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea134d-555e-4ae9-b57b-adeed4aa9e18 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.008157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604542b-59a3-4c2c-a047-fe338f79ecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.008807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604542b-59a3-4c2c-a047-fe338f79ecc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.009120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604542b-59a3-4c2c-a047-fe338f79ecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.009352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604542b-59a3-4c2c-a047-fe338f79ecc1 admin admin] PATH_INFO: `/v3/projects/2bef42dd9b8f42b891b3d0621a300253/users/af781cc31545407d98675a0de1727b65/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.013435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f2d45-57ac-4fa7-86c5-2317bd58ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.014034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f2d45-57ac-4fa7-86c5-2317bd58ce74 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.014310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f2d45-57ac-4fa7-86c5-2317bd58ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.014610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f2d45-57ac-4fa7-86c5-2317bd58ce74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.015245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f2d45-57ac-4fa7-86c5-2317bd58ce74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.016831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f2d45-57ac-4fa7-86c5-2317bd58ce74 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.026723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604542b-59a3-4c2c-a047-fe338f79ecc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bef42dd9b8f42b891b3d0621a300253, user_id=af781cc31545407d98675a0de1727b65, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.028430 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 794/1593] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:26.029239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f2d45-57ac-4fa7-86c5-2317bd58ce74 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.029639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604542b-59a3-4c2c-a047-fe338f79ecc1 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.040630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f2d45-57ac-4fa7-86c5-2317bd58ce74 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.045246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f68e5-ab17-4bcb-8721-030838688c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.045837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f68e5-ab17-4bcb-8721-030838688c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.046574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f68e5-ab17-4bcb-8721-030838688c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.046574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f68e5-ab17-4bcb-8721-030838688c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.047104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f68e5-ab17-4bcb-8721-030838688c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.048675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f68e5-ab17-4bcb-8721-030838688c6d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.058672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 795/1594] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:26.059268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f68e5-ab17-4bcb-8721-030838688c6d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.069210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f68e5-ab17-4bcb-8721-030838688c6d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.073736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cb499-f3a1-488f-b30a-7e555394848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.074275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb499-f3a1-488f-b30a-7e555394848c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.074577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb499-f3a1-488f-b30a-7e555394848c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.074850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb499-f3a1-488f-b30a-7e555394848c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.075505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cb499-f3a1-488f-b30a-7e555394848c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.076991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cb499-f3a1-488f-b30a-7e555394848c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.087297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 796/1595] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:26.092728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cb499-f3a1-488f-b30a-7e555394848c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.098130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cb499-f3a1-488f-b30a-7e555394848c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.103872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.104658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.105005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.105351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] PATH_INFO: `/v3/projects/51d8d2cc1d264271a7665300db502bbb/users/5896dac87ac84f99adfffedec7c63a70/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.109596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 800/1596] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:25 2022] PUT /identity/v3/projects/2bef42dd9b8f42b891b3d0621a300253/users/af781cc31545407d98675a0de1727b65/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:26.110537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604542b-59a3-4c2c-a047-fe338f79ecc1 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.121895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d8d2cc1d264271a7665300db502bbb, user_id=5896dac87ac84f99adfffedec7c63a70, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.123265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING py.warnings [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:41:26.123265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: warnings.warn(msg) Aug 10 08:41:26.123265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: Aug 10 08:41:26.125940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.172814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 797/1597] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:26 2022] PUT /identity/v3/projects/51d8d2cc1d264271a7665300db502bbb/users/5896dac87ac84f99adfffedec7c63a70/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:26.173847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.203014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604542b-59a3-4c2c-a047-fe338f79ecc1 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.237468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:26.246101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd66ad-47fd-4c95-a063-a302adb11a49 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.251030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad60f2d-c8b5-4132-8937-92809b728466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.251866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad60f2d-c8b5-4132-8937-92809b728466 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.252245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad60f2d-c8b5-4132-8937-92809b728466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.252497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad60f2d-c8b5-4132-8937-92809b728466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.253161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad60f2d-c8b5-4132-8937-92809b728466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.254821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad60f2d-c8b5-4132-8937-92809b728466 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.263204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e7d21-0318-4845-9107-4cb4deb7cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.263809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7d21-0318-4845-9107-4cb4deb7cd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.264082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7d21-0318-4845-9107-4cb4deb7cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.264351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7d21-0318-4845-9107-4cb4deb7cd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.264830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 798/1598] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:26.264989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e7d21-0318-4845-9107-4cb4deb7cd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.265701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad60f2d-c8b5-4132-8937-92809b728466 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.266666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e7d21-0318-4845-9107-4cb4deb7cd40 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.275637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad60f2d-c8b5-4132-8937-92809b728466 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.280104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 801/1599] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:26.280104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e7d21-0318-4845-9107-4cb4deb7cd40 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.280476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274834d-18d4-4f35-92d3-81c7d2c8f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.281129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274834d-18d4-4f35-92d3-81c7d2c8f2df admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.281404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274834d-18d4-4f35-92d3-81c7d2c8f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.281674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274834d-18d4-4f35-92d3-81c7d2c8f2df admin admin] PATH_INFO: `/v3/projects/fd42ddf1ccf54e1598b65a08b08774b7/users/661a67fbdd6941889c706d2560c920a2/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.289229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e7d21-0318-4845-9107-4cb4deb7cd40 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.295872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d45dd-9bbf-44b5-9b3c-a183a7bd0e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.299291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d45dd-9bbf-44b5-9b3c-a183a7bd0e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.299291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d45dd-9bbf-44b5-9b3c-a183a7bd0e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.299291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d45dd-9bbf-44b5-9b3c-a183a7bd0e38 admin admin] PATH_INFO: `/v3/projects/3e4e527caeca4745b17978c83760553e/users/10be10e09f104b35a596ba3f56e98a65/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.299539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274834d-18d4-4f35-92d3-81c7d2c8f2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd42ddf1ccf54e1598b65a08b08774b7, user_id=661a67fbdd6941889c706d2560c920a2, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.301395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274834d-18d4-4f35-92d3-81c7d2c8f2df admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.313854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d45dd-9bbf-44b5-9b3c-a183a7bd0e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4e527caeca4745b17978c83760553e, user_id=10be10e09f104b35a596ba3f56e98a65, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.317679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d45dd-9bbf-44b5-9b3c-a183a7bd0e38 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.434387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 799/1600] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:26 2022] PUT /identity/v3/projects/fd42ddf1ccf54e1598b65a08b08774b7/users/661a67fbdd6941889c706d2560c920a2/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:26.435157 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274834d-18d4-4f35-92d3-81c7d2c8f2df admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.445093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 802/1601] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:26 2022] PUT /identity/v3/projects/3e4e527caeca4745b17978c83760553e/users/10be10e09f104b35a596ba3f56e98a65/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:26.446616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71456d4b-219a-4faa-b9d2-a0c9145eefd2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.446902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71456d4b-219a-4faa-b9d2-a0c9145eefd2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.447174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71456d4b-219a-4faa-b9d2-a0c9145eefd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.469678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:26.476459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-71456d4b-219a-4faa-b9d2-a0c9145eefd2 None None] MFA Rules not processed for user `af781cc31545407d98675a0de1727b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:26.477690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-71456d4b-219a-4faa-b9d2-a0c9145eefd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:26.500170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274834d-18d4-4f35-92d3-81c7d2c8f2df admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.504878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38deff0-61fe-48c4-9dc3-06a42fb54152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.505483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38deff0-61fe-48c4-9dc3-06a42fb54152 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.505756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38deff0-61fe-48c4-9dc3-06a42fb54152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.506026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38deff0-61fe-48c4-9dc3-06a42fb54152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.506692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38deff0-61fe-48c4-9dc3-06a42fb54152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.508280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38deff0-61fe-48c4-9dc3-06a42fb54152 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.517886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 800/1602] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:26.519190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c4ed-9894-4fd2-a4b3-45c749adfe87 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.519476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c4ed-9894-4fd2-a4b3-45c749adfe87 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.519750 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c4ed-9894-4fd2-a4b3-45c749adfe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.548095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 803/1603] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:26.554540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71456d4b-219a-4faa-b9d2-a0c9145eefd2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.554679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5335c4ed-9894-4fd2-a4b3-45c749adfe87 None None] MFA Rules not processed for user `5896dac87ac84f99adfffedec7c63a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:26.554679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5335c4ed-9894-4fd2-a4b3-45c749adfe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:26.560862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71456d4b-219a-4faa-b9d2-a0c9145eefd2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.566430 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3e9f-e6bb-4f59-8054-27bd371f1319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.567220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3e9f-e6bb-4f59-8054-27bd371f1319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.567565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3e9f-e6bb-4f59-8054-27bd371f1319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.568309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3e9f-e6bb-4f59-8054-27bd371f1319 admin admin] PATH_INFO: `/v3/projects/a1554973bf4b4523b966a9d851b0244a/users/0c316e7b121b4d859d9677edcb49be45/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.586944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3e9f-e6bb-4f59-8054-27bd371f1319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1554973bf4b4523b966a9d851b0244a, user_id=0c316e7b121b4d859d9677edcb49be45, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.590242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3e9f-e6bb-4f59-8054-27bd371f1319 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.616542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 801/1604] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:26.617525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c4ed-9894-4fd2-a4b3-45c749adfe87 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.628886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c4ed-9894-4fd2-a4b3-45c749adfe87 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.633600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d81b-562f-44dd-b97d-1297b649d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.634296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d81b-562f-44dd-b97d-1297b649d57b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.634606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d81b-562f-44dd-b97d-1297b649d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.634883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d81b-562f-44dd-b97d-1297b649d57b admin admin] PATH_INFO: `/v3/projects/d9bd87e8826b4d4b8b0412c05dcc7c76/users/b2791f0335c94665b07214993ab46638/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.650673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173d81b-562f-44dd-b97d-1297b649d57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bd87e8826b4d4b8b0412c05dcc7c76, user_id=b2791f0335c94665b07214993ab46638, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.653372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173d81b-562f-44dd-b97d-1297b649d57b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.697600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 804/1605] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:26 2022] PUT /identity/v3/projects/a1554973bf4b4523b966a9d851b0244a/users/0c316e7b121b4d859d9677edcb49be45/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:26.699112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96c41-fe11-47cd-9daf-048f4f9e79f6 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.699260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96c41-fe11-47cd-9daf-048f4f9e79f6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.699477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96c41-fe11-47cd-9daf-048f4f9e79f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.718578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-97b96c41-fe11-47cd-9daf-048f4f9e79f6 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:26.719977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-97b96c41-fe11-47cd-9daf-048f4f9e79f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:26.720960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 802/1606] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:26 2022] PUT /identity/v3/projects/d9bd87e8826b4d4b8b0412c05dcc7c76/users/b2791f0335c94665b07214993ab46638/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:26.722128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18708f5b-170e-491e-b601-8ac7467aef7d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.722522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18708f5b-170e-491e-b601-8ac7467aef7d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.722956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18708f5b-170e-491e-b601-8ac7467aef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.752204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-18708f5b-170e-491e-b601-8ac7467aef7d None None] MFA Rules not processed for user `10be10e09f104b35a596ba3f56e98a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:26.753563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-18708f5b-170e-491e-b601-8ac7467aef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:26.792997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 805/1607] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:26.793913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96c41-fe11-47cd-9daf-048f4f9e79f6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.809674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96c41-fe11-47cd-9daf-048f4f9e79f6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.815156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a63fab-d84f-4179-ac55-97db80f02b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.815949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a63fab-d84f-4179-ac55-97db80f02b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.816230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a63fab-d84f-4179-ac55-97db80f02b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.816506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a63fab-d84f-4179-ac55-97db80f02b4c admin admin] PATH_INFO: `/v3/projects/5c6694dd460a467a986bcaa0e5e000a9/users/d28b7a7b2e0143cf9ee6e761eb7fb281/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.829486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 803/1608] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:26.831603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18708f5b-170e-491e-b601-8ac7467aef7d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.833992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:26.836634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a63fab-d84f-4179-ac55-97db80f02b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6694dd460a467a986bcaa0e5e000a9, user_id=d28b7a7b2e0143cf9ee6e761eb7fb281, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.839454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a63fab-d84f-4179-ac55-97db80f02b4c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.844847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18708f5b-170e-491e-b601-8ac7467aef7d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:26.849548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83527a14-5a3b-4b2c-988a-d7b7b076a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:26.850147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527a14-5a3b-4b2c-988a-d7b7b076a9be admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.850420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527a14-5a3b-4b2c-988a-d7b7b076a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.850717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527a14-5a3b-4b2c-988a-d7b7b076a9be admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.851335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83527a14-5a3b-4b2c-988a-d7b7b076a9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:26.853227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83527a14-5a3b-4b2c-988a-d7b7b076a9be admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:26.943121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:26.949061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 806/1609] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:26 2022] PUT /identity/v3/projects/5c6694dd460a467a986bcaa0e5e000a9/users/d28b7a7b2e0143cf9ee6e761eb7fb281/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:26.949716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a63fab-d84f-4179-ac55-97db80f02b4c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:26.953736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 804/1610] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:26 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:26.953736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aea29-eb3d-498d-9b0f-78269ed6a3d0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:26.953736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aea29-eb3d-498d-9b0f-78269ed6a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:26.953736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aea29-eb3d-498d-9b0f-78269ed6a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:26.971266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4c3aea29-eb3d-498d-9b0f-78269ed6a3d0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:26.972395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4c3aea29-eb3d-498d-9b0f-78269ed6a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:27.018401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a63fab-d84f-4179-ac55-97db80f02b4c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.037298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 805/1611] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:27.041798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068d1ae-ebe0-490b-b702-bdbaa744c082 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.042151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068d1ae-ebe0-490b-b702-bdbaa744c082 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.042515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068d1ae-ebe0-490b-b702-bdbaa744c082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.077385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d068d1ae-ebe0-490b-b702-bdbaa744c082 None None] MFA Rules not processed for user `b2791f0335c94665b07214993ab46638`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:27.078775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d068d1ae-ebe0-490b-b702-bdbaa744c082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:27.092759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05638719-6ae6-4fa5-b33d-16a50b38b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.093605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05638719-6ae6-4fa5-b33d-16a50b38b490 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.094063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05638719-6ae6-4fa5-b33d-16a50b38b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.094331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05638719-6ae6-4fa5-b33d-16a50b38b490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.095025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05638719-6ae6-4fa5-b33d-16a50b38b490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.096951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05638719-6ae6-4fa5-b33d-16a50b38b490 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.145998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 806/1612] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:27.147012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068d1ae-ebe0-490b-b702-bdbaa744c082 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.202392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068d1ae-ebe0-490b-b702-bdbaa744c082 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.207169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 807/1613] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:26 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:27.207169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05638719-6ae6-4fa5-b33d-16a50b38b490 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.247909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:27.255586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecdb88-1f40-43dd-b1af-2544bdd10fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.256217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecdb88-1f40-43dd-b1af-2544bdd10fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.256632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecdb88-1f40-43dd-b1af-2544bdd10fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.256913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecdb88-1f40-43dd-b1af-2544bdd10fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.268209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05638719-6ae6-4fa5-b33d-16a50b38b490 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.274140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6715889-3753-46f7-bc59-80ac0b6900bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.274799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715889-3753-46f7-bc59-80ac0b6900bb admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.275074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715889-3753-46f7-bc59-80ac0b6900bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.275346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6715889-3753-46f7-bc59-80ac0b6900bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.275984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6715889-3753-46f7-bc59-80ac0b6900bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.277957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6715889-3753-46f7-bc59-80ac0b6900bb admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.331024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecdb88-1f40-43dd-b1af-2544bdd10fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.333025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecdb88-1f40-43dd-b1af-2544bdd10fd1 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.342597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 807/1614] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:27.343863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded152e5-dfda-4862-9139-ca86124a606e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.344108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded152e5-dfda-4862-9139-ca86124a606e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.344381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded152e5-dfda-4862-9139-ca86124a606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.369155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ded152e5-dfda-4862-9139-ca86124a606e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:27.370300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ded152e5-dfda-4862-9139-ca86124a606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:27.383319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 808/1615] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:27.384309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded152e5-dfda-4862-9139-ca86124a606e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.387460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 808/1616] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:27 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:27.388552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6715889-3753-46f7-bc59-80ac0b6900bb admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.396660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded152e5-dfda-4862-9139-ca86124a606e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.403662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:27.456139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6715889-3753-46f7-bc59-80ac0b6900bb admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.460817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba91ba-3644-4a61-82dc-495525e06558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.461521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba91ba-3644-4a61-82dc-495525e06558 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.461874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba91ba-3644-4a61-82dc-495525e06558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.462209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba91ba-3644-4a61-82dc-495525e06558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.463366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21766c89-47fb-4a74-a1b0-08900228142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.464100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766c89-47fb-4a74-a1b0-08900228142b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.464519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766c89-47fb-4a74-a1b0-08900228142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.464894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766c89-47fb-4a74-a1b0-08900228142b admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.465630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21766c89-47fb-4a74-a1b0-08900228142b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.467870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21766c89-47fb-4a74-a1b0-08900228142b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.481054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba91ba-3644-4a61-82dc-495525e06558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.482707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba91ba-3644-4a61-82dc-495525e06558 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.494654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 809/1617] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:27.496016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a35b-1508-4c76-972a-b6a5b2f59111 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.496357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a35b-1508-4c76-972a-b6a5b2f59111 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.496690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a35b-1508-4c76-972a-b6a5b2f59111 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.498342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 810/1618] 10.222.0.45 () {54 vars in 962 bytes} [Wed Aug 10 08:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:41:27.499123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39a35b-1508-4c76-972a-b6a5b2f59111 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.518397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39a35b-1508-4c76-972a-b6a5b2f59111 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.530127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e5ba7-1907-45a4-932b-65b98f9029da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.530942 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e5ba7-1907-45a4-932b-65b98f9029da admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.531316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e5ba7-1907-45a4-932b-65b98f9029da admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.531709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e5ba7-1907-45a4-932b-65b98f9029da admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.533131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e5ba7-1907-45a4-932b-65b98f9029da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.534995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e5ba7-1907-45a4-932b-65b98f9029da admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.549029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 809/1619] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:27 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:27.549866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21766c89-47fb-4a74-a1b0-08900228142b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.569206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21766c89-47fb-4a74-a1b0-08900228142b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.574005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c96b4-032a-4bc7-b501-e49ab0ba50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.574681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c96b4-032a-4bc7-b501-e49ab0ba50eb admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.574965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c96b4-032a-4bc7-b501-e49ab0ba50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.575239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c96b4-032a-4bc7-b501-e49ab0ba50eb admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.575877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c96b4-032a-4bc7-b501-e49ab0ba50eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.577909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c96b4-032a-4bc7-b501-e49ab0ba50eb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.636220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 811/1620] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:27 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:27.637199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e5ba7-1907-45a4-932b-65b98f9029da admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.647813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e5ba7-1907-45a4-932b-65b98f9029da admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.663191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 810/1621] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:27 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:27.665544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79610258-d509-4173-9232-fd3a5cc236dc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.666453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79610258-d509-4173-9232-fd3a5cc236dc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.667651 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79610258-d509-4173-9232-fd3a5cc236dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.668448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3baba9-7302-484e-b754-bb186ccc420d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.669178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3baba9-7302-484e-b754-bb186ccc420d service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.669555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3baba9-7302-484e-b754-bb186ccc420d service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.669889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3baba9-7302-484e-b754-bb186ccc420d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.694121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3baba9-7302-484e-b754-bb186ccc420d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.695781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3baba9-7302-484e-b754-bb186ccc420d service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.717619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 812/1622] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:27.718851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3baba9-7302-484e-b754-bb186ccc420d service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.731909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-79610258-d509-4173-9232-fd3a5cc236dc None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:27.734203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-79610258-d509-4173-9232-fd3a5cc236dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:27.742243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3baba9-7302-484e-b754-bb186ccc420d service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.755729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c14cc-22d2-4f79-b633-215544121462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.756357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c14cc-22d2-4f79-b633-215544121462 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.756691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c14cc-22d2-4f79-b633-215544121462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.756972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c14cc-22d2-4f79-b633-215544121462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.757711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c14cc-22d2-4f79-b633-215544121462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.760806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c14cc-22d2-4f79-b633-215544121462 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.779542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 813/1623] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:27.779542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c14cc-22d2-4f79-b633-215544121462 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.794542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c14cc-22d2-4f79-b633-215544121462 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.798976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:27.803102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cafa3-817d-4849-a231-4ea252804879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.803750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cafa3-817d-4849-a231-4ea252804879 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.804031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cafa3-817d-4849-a231-4ea252804879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.804302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cafa3-817d-4849-a231-4ea252804879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.805287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cafa3-817d-4849-a231-4ea252804879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.808011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cafa3-817d-4849-a231-4ea252804879 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.836273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 814/1624] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:27.843454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cafa3-817d-4849-a231-4ea252804879 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.844770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 811/1625] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Aug 10 08:41:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:27.845714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79610258-d509-4173-9232-fd3a5cc236dc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.857233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cafa3-817d-4849-a231-4ea252804879 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.858967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79610258-d509-4173-9232-fd3a5cc236dc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.863818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ce1a9-a66f-44ad-8fc8-1b221915604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.866695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce1a9-a66f-44ad-8fc8-1b221915604e admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.866695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce1a9-a66f-44ad-8fc8-1b221915604e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.866695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce1a9-a66f-44ad-8fc8-1b221915604e admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.866695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ce1a9-a66f-44ad-8fc8-1b221915604e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.867132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51535468-81fb-4140-a395-54d2c191e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.867490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ce1a9-a66f-44ad-8fc8-1b221915604e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.868206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51535468-81fb-4140-a395-54d2c191e453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.869123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51535468-81fb-4140-a395-54d2c191e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.869675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51535468-81fb-4140-a395-54d2c191e453 admin admin] PATH_INFO: `/v3/projects/478b5bc9a8fa4f9699dcc01b3d9fdccb/users/498954aff1434c058b4a4d5f9eb9c48c/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.881260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 815/1626] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:27.882195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ce1a9-a66f-44ad-8fc8-1b221915604e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.893800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51535468-81fb-4140-a395-54d2c191e453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478b5bc9a8fa4f9699dcc01b3d9fdccb, user_id=498954aff1434c058b4a4d5f9eb9c48c, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.896208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51535468-81fb-4140-a395-54d2c191e453 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.918034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ce1a9-a66f-44ad-8fc8-1b221915604e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:27.931384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86948677-f69c-44b1-9f7c-02655622b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:27.932653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948677-f69c-44b1-9f7c-02655622b158 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:27.932957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948677-f69c-44b1-9f7c-02655622b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:27.933269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948677-f69c-44b1-9f7c-02655622b158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:27.934552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86948677-f69c-44b1-9f7c-02655622b158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:27.937050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86948677-f69c-44b1-9f7c-02655622b158 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:27.956225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 812/1627] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:27 2022] PUT /identity/v3/projects/478b5bc9a8fa4f9699dcc01b3d9fdccb/users/498954aff1434c058b4a4d5f9eb9c48c/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:27.956972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51535468-81fb-4140-a395-54d2c191e453 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.975417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 816/1628] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:27.975417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86948677-f69c-44b1-9f7c-02655622b158 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:27.992615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86948677-f69c-44b1-9f7c-02655622b158 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:28.069124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51535468-81fb-4140-a395-54d2c191e453 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:28.079432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415dd8-3810-4100-807b-a335283d9add service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:28.080501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415dd8-3810-4100-807b-a335283d9add service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.086214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415dd8-3810-4100-807b-a335283d9add service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.086214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415dd8-3810-4100-807b-a335283d9add service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.117482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5efc6-73ec-484e-b1d4-a726d79cd0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:28.118160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5efc6-73ec-484e-b1d4-a726d79cd0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.118440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5efc6-73ec-484e-b1d4-a726d79cd0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.118742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5efc6-73ec-484e-b1d4-a726d79cd0f2 admin admin] PATH_INFO: `/v3/projects/c48eb292c41648ab8a21e91c880fa055/users/df9c3a9c5c1146d2a20c743e0d979cae/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.146617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5efc6-73ec-484e-b1d4-a726d79cd0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48eb292c41648ab8a21e91c880fa055, user_id=df9c3a9c5c1146d2a20c743e0d979cae, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:28.150131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5efc6-73ec-484e-b1d4-a726d79cd0f2 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:28.173783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23415dd8-3810-4100-807b-a335283d9add service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:28.175857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23415dd8-3810-4100-807b-a335283d9add service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:28.187398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 813/1629] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:28.188569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415dd8-3810-4100-807b-a335283d9add service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:28.202174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415dd8-3810-4100-807b-a335283d9add service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:28.209479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9708-cb64-4abc-98c5-668d4ca6e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:28.210459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9708-cb64-4abc-98c5-668d4ca6e36f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.211131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9708-cb64-4abc-98c5-668d4ca6e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.211617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9708-cb64-4abc-98c5-668d4ca6e36f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.212499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae9708-cb64-4abc-98c5-668d4ca6e36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:28.214738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae9708-cb64-4abc-98c5-668d4ca6e36f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:28.228812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 814/1630] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:28.230180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9708-cb64-4abc-98c5-668d4ca6e36f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:28.258209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 817/1631] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:27 2022] PUT /identity/v3/projects/c48eb292c41648ab8a21e91c880fa055/users/df9c3a9c5c1146d2a20c743e0d979cae/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:28.260040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5efc6-73ec-484e-b1d4-a726d79cd0f2 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:28.278295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9708-cb64-4abc-98c5-668d4ca6e36f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:28.316755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:28.385369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:28.441215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152ca7-eb78-4d54-8063-0956efcd3ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:28.444029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152ca7-eb78-4d54-8063-0956efcd3ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.445745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152ca7-eb78-4d54-8063-0956efcd3ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.447195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152ca7-eb78-4d54-8063-0956efcd3ea3 admin admin] PATH_INFO: `/v3/projects/45a39f01895c4b06a2dc4fdd9b214245/users/0d7354d60fc0469ea94f1a38df352ab9/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.458614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5efc6-73ec-484e-b1d4-a726d79cd0f2 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:28.482115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19786-d4c2-4565-944d-39f836bfb74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:28.482847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19786-d4c2-4565-944d-39f836bfb74d admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.484058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19786-d4c2-4565-944d-39f836bfb74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.484058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19786-d4c2-4565-944d-39f836bfb74d admin admin] PATH_INFO: `/v3/projects/478b5bc9a8fa4f9699dcc01b3d9fdccb/users/498954aff1434c058b4a4d5f9eb9c48c/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.500373 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea19786-d4c2-4565-944d-39f836bfb74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=478b5bc9a8fa4f9699dcc01b3d9fdccb, user_id=498954aff1434c058b4a4d5f9eb9c48c, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:28.506371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea19786-d4c2-4565-944d-39f836bfb74d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:28.522166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152ca7-eb78-4d54-8063-0956efcd3ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a39f01895c4b06a2dc4fdd9b214245, user_id=0d7354d60fc0469ea94f1a38df352ab9, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:28.526116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152ca7-eb78-4d54-8063-0956efcd3ea3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:28.539089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 818/1632] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:28 2022] PUT /identity/v3/projects/478b5bc9a8fa4f9699dcc01b3d9fdccb/users/498954aff1434c058b4a4d5f9eb9c48c/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:28.539961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19786-d4c2-4565-944d-39f836bfb74d admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:28.601660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 815/1633] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:28 2022] PUT /identity/v3/projects/45a39f01895c4b06a2dc4fdd9b214245/users/0d7354d60fc0469ea94f1a38df352ab9/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:28.603348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4135d-c62a-4c46-886a-9ea9bcaa7cd7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.603348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4135d-c62a-4c46-886a-9ea9bcaa7cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.613388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4135d-c62a-4c46-886a-9ea9bcaa7cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.736208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2df4135d-c62a-4c46-886a-9ea9bcaa7cd7 None None] MFA Rules not processed for user `498954aff1434c058b4a4d5f9eb9c48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:28.736208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2df4135d-c62a-4c46-886a-9ea9bcaa7cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:28.746933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19786-d4c2-4565-944d-39f836bfb74d admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:28.838998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 816/1634] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:28.841392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb7e6-f2ef-449a-afec-8329f27c746e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.841392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb7e6-f2ef-449a-afec-8329f27c746e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.841392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acb7e6-f2ef-449a-afec-8329f27c746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.857374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a58962-7a82-497a-83e1-9c253d5771ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:28.858010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58962-7a82-497a-83e1-9c253d5771ac admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.858288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58962-7a82-497a-83e1-9c253d5771ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.858601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58962-7a82-497a-83e1-9c253d5771ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.859259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a58962-7a82-497a-83e1-9c253d5771ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:28.861182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a58962-7a82-497a-83e1-9c253d5771ac admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:28.880405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 819/1635] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:28.881353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a58962-7a82-497a-83e1-9c253d5771ac admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:28.885603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-28acb7e6-f2ef-449a-afec-8329f27c746e None None] MFA Rules not processed for user `0d7354d60fc0469ea94f1a38df352ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:28.888523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-28acb7e6-f2ef-449a-afec-8329f27c746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:28.975752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a58962-7a82-497a-83e1-9c253d5771ac admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:28.980748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa45d3-51c5-4745-be3f-602b6beab9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:28.981612 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa45d3-51c5-4745-be3f-602b6beab9dd service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:28.981947 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa45d3-51c5-4745-be3f-602b6beab9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:28.983681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa45d3-51c5-4745-be3f-602b6beab9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:28.995964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 817/1636] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:29.001516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acb7e6-f2ef-449a-afec-8329f27c746e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:29.001768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa45d3-51c5-4745-be3f-602b6beab9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:29.008046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa45d3-51c5-4745-be3f-602b6beab9dd service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:29.014454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:29.017421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acb7e6-f2ef-449a-afec-8329f27c746e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:29.036394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d2289-8709-4207-a35d-f5e949cae722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:29.037514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 820/1637] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:29.037622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d2289-8709-4207-a35d-f5e949cae722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.037622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d2289-8709-4207-a35d-f5e949cae722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.037774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa45d3-51c5-4745-be3f-602b6beab9dd service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:29.037851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d2289-8709-4207-a35d-f5e949cae722 admin admin] PATH_INFO: `/v3/projects/c48eb292c41648ab8a21e91c880fa055/users/df9c3a9c5c1146d2a20c743e0d979cae/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.037851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d2289-8709-4207-a35d-f5e949cae722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48eb292c41648ab8a21e91c880fa055, user_id=df9c3a9c5c1146d2a20c743e0d979cae, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:29.037851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d2289-8709-4207-a35d-f5e949cae722 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:29.049084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 818/1638] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:28 2022] PUT /identity/v3/projects/c48eb292c41648ab8a21e91c880fa055/users/df9c3a9c5c1146d2a20c743e0d979cae/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:29.061746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd04cc-055d-4651-bb19-f3c86e0dcd15 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.062062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd04cc-055d-4651-bb19-f3c86e0dcd15 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.062344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd04cc-055d-4651-bb19-f3c86e0dcd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.062938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa45d3-51c5-4745-be3f-602b6beab9dd service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:29.152592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-40fd04cc-055d-4651-bb19-f3c86e0dcd15 None None] MFA Rules not processed for user `df9c3a9c5c1146d2a20c743e0d979cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:29.153693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-40fd04cc-055d-4651-bb19-f3c86e0dcd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:29.182526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:29.186262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250d90a-33fa-48cd-8e45-066b7dac342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:29.187080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250d90a-33fa-48cd-8e45-066b7dac342c admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.187960 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250d90a-33fa-48cd-8e45-066b7dac342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.188467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250d90a-33fa-48cd-8e45-066b7dac342c admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.189229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250d90a-33fa-48cd-8e45-066b7dac342c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:29.191884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250d90a-33fa-48cd-8e45-066b7dac342c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:29.307218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 819/1639] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:41:29.307218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5574bb-5389-461c-a1c9-3ea80c5f1a3b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.307218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5574bb-5389-461c-a1c9-3ea80c5f1a3b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.307218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5574bb-5389-461c-a1c9-3ea80c5f1a3b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.307624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 821/1640] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:29 2022] POST /identity/v3/projects => generated 387 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:29.307624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250d90a-33fa-48cd-8e45-066b7dac342c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:29.310256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 820/1641] 10.222.0.45 () {54 vars in 962 bytes} [Wed Aug 10 08:41:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:41:29.311368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5574bb-5389-461c-a1c9-3ea80c5f1a3b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:29.418912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5574bb-5389-461c-a1c9-3ea80c5f1a3b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:29.425901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b2272-223d-4f91-84fe-4dec13e6a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:29.427403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2272-223d-4f91-84fe-4dec13e6a080 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.427692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2272-223d-4f91-84fe-4dec13e6a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.427965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2272-223d-4f91-84fe-4dec13e6a080 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.428652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b2272-223d-4f91-84fe-4dec13e6a080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:29.430922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b2272-223d-4f91-84fe-4dec13e6a080 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:29.485961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250d90a-33fa-48cd-8e45-066b7dac342c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:29.495518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0c112-6630-44d4-9020-34baf3d94cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:29.496159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0c112-6630-44d4-9020-34baf3d94cef service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.496436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0c112-6630-44d4-9020-34baf3d94cef service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.496702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0c112-6630-44d4-9020-34baf3d94cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.550599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 821/1642] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:29 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:29.550599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0f8b-5b96-4f6d-92b8-a212e6b80909 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.550599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0f8b-5b96-4f6d-92b8-a212e6b80909 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.550599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c0f8b-5b96-4f6d-92b8-a212e6b80909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.602814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-693c0f8b-5b96-4f6d-92b8-a212e6b80909 None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:29.605082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-693c0f8b-5b96-4f6d-92b8-a212e6b80909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:29.607489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0c112-6630-44d4-9020-34baf3d94cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:29.609602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0c112-6630-44d4-9020-34baf3d94cef service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:29.639858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 822/1643] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:29.641565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0c112-6630-44d4-9020-34baf3d94cef service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:29.695308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0c112-6630-44d4-9020-34baf3d94cef service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:29.712788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f740f82-3654-4cce-80ae-28539d1b3572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:29.714115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f740f82-3654-4cce-80ae-28539d1b3572 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.714650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f740f82-3654-4cce-80ae-28539d1b3572 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.715221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f740f82-3654-4cce-80ae-28539d1b3572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.753629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 822/1644] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Aug 10 08:41:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:29.754800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c0f8b-5b96-4f6d-92b8-a212e6b80909 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:29.774923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c0f8b-5b96-4f6d-92b8-a212e6b80909 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:29.805509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3312dd-e26d-4d18-a4ca-0d6ca04d7b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:29.806871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312dd-e26d-4d18-a4ca-0d6ca04d7b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.807148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312dd-e26d-4d18-a4ca-0d6ca04d7b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.807924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312dd-e26d-4d18-a4ca-0d6ca04d7b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.808128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3312dd-e26d-4d18-a4ca-0d6ca04d7b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:29.816212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3312dd-e26d-4d18-a4ca-0d6ca04d7b2d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:29.839501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 823/1645] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:29.840827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea985f-426d-4e0d-b73c-619fbf82a711 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:29.841144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea985f-426d-4e0d-b73c-619fbf82a711 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:29.843174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea985f-426d-4e0d-b73c-619fbf82a711 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:29.846330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 824/1646] 10.222.0.45 () {54 vars in 912 bytes} [Wed Aug 10 08:41:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:41:29.853556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea985f-426d-4e0d-b73c-619fbf82a711 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:29.865117 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f740f82-3654-4cce-80ae-28539d1b3572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:29.868029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f740f82-3654-4cce-80ae-28539d1b3572 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:29.885539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea985f-426d-4e0d-b73c-619fbf82a711 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:30.142654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 823/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:30.142654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7f03-fbe3-40df-89fa-fcd3111fd2ed None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.142654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7f03-fbe3-40df-89fa-fcd3111fd2ed None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.142654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7f03-fbe3-40df-89fa-fcd3111fd2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.149783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3132a2-095c-4c93-8342-39aa78dd4157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:30.149783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3132a2-095c-4c93-8342-39aa78dd4157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.149783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3132a2-095c-4c93-8342-39aa78dd4157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.149783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3132a2-095c-4c93-8342-39aa78dd4157 admin admin] PATH_INFO: `/v3/projects/b987673c4dd04bf7a0850dd669874bad/users/c8ae15a0c0f54fdcb48b3ac2044ba187/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.151391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3132a2-095c-4c93-8342-39aa78dd4157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b987673c4dd04bf7a0850dd669874bad, user_id=c8ae15a0c0f54fdcb48b3ac2044ba187, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:30.151391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3132a2-095c-4c93-8342-39aa78dd4157 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:30.152446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7f3c7f03-fbe3-40df-89fa-fcd3111fd2ed None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:30.152446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7f3c7f03-fbe3-40df-89fa-fcd3111fd2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:30.152446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:30.152446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 824/1648] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:41:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:30.152446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7f03-fbe3-40df-89fa-fcd3111fd2ed None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:30.152446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7f03-fbe3-40df-89fa-fcd3111fd2ed None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:30.154349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300516-36d7-47b5-b523-f4951cbeaf59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:30.154349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300516-36d7-47b5-b523-f4951cbeaf59 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.154349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300516-36d7-47b5-b523-f4951cbeaf59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.154349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300516-36d7-47b5-b523-f4951cbeaf59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.157915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 825/1649] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:29 2022] PUT /identity/v3/projects/b987673c4dd04bf7a0850dd669874bad/users/c8ae15a0c0f54fdcb48b3ac2044ba187/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:30.157915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3132a2-095c-4c93-8342-39aa78dd4157 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:30.158560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e300516-36d7-47b5-b523-f4951cbeaf59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:30.158560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e300516-36d7-47b5-b523-f4951cbeaf59 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:30.158560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 825/1650] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:41:30.255533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3132a2-095c-4c93-8342-39aa78dd4157 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:30.262997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cee46-3f68-4e57-aa93-768077a5e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:30.265837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cee46-3f68-4e57-aa93-768077a5e40a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.265837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cee46-3f68-4e57-aa93-768077a5e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.265837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cee46-3f68-4e57-aa93-768077a5e40a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.265837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cee46-3f68-4e57-aa93-768077a5e40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:30.267625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cee46-3f68-4e57-aa93-768077a5e40a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:30.288656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 826/1651] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:41:30.290143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300516-36d7-47b5-b523-f4951cbeaf59 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:30.305646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300516-36d7-47b5-b523-f4951cbeaf59 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:30.313370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12f528-a2df-486c-b3d6-0c179caa47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:30.314346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f528-a2df-486c-b3d6-0c179caa47fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.314842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f528-a2df-486c-b3d6-0c179caa47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.315295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f528-a2df-486c-b3d6-0c179caa47fe admin admin] PATH_INFO: `/v3/projects/b987673c4dd04bf7a0850dd669874bad/users/c8ae15a0c0f54fdcb48b3ac2044ba187/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.320314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12f528-a2df-486c-b3d6-0c179caa47fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b987673c4dd04bf7a0850dd669874bad, user_id=c8ae15a0c0f54fdcb48b3ac2044ba187, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:30.324034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12f528-a2df-486c-b3d6-0c179caa47fe admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:30.338059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 826/1652] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:30 2022] PUT /identity/v3/projects/b987673c4dd04bf7a0850dd669874bad/users/c8ae15a0c0f54fdcb48b3ac2044ba187/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:30.349506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db15f0-dda8-4896-8a74-cabdfff9d0af None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.350284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db15f0-dda8-4896-8a74-cabdfff9d0af None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.350681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db15f0-dda8-4896-8a74-cabdfff9d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.408178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d1db15f0-dda8-4896-8a74-cabdfff9d0af None None] MFA Rules not processed for user `c8ae15a0c0f54fdcb48b3ac2044ba187`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:30.411157 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d1db15f0-dda8-4896-8a74-cabdfff9d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:30.540785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba758c8-00dd-486f-99e9-f7574f9fbcc1 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.541972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba758c8-00dd-486f-99e9-f7574f9fbcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.542357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba758c8-00dd-486f-99e9-f7574f9fbcc1 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.549479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 827/1653] 10.222.0.45 () {54 vars in 912 bytes} [Wed Aug 10 08:41:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:41:30.558594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a7cb-35a9-4ae8-9bd0-95b325d73cf5 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.558929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a7cb-35a9-4ae8-9bd0-95b325d73cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.559209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a7cb-35a9-4ae8-9bd0-95b325d73cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.584260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-c182a7cb-35a9-4ae8-9bd0-95b325d73cf5 None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:30.585882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c182a7cb-35a9-4ae8-9bd0-95b325d73cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:30.628286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:30.662751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 827/1654] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:30.664461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db15f0-dda8-4896-8a74-cabdfff9d0af None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:30.698781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 828/1655] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:41:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:41:30.768795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db15f0-dda8-4896-8a74-cabdfff9d0af None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:30.782752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859c399-6590-4879-bd56-386c7b267a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:30.790094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859c399-6590-4879-bd56-386c7b267a54 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:30.790387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859c399-6590-4879-bd56-386c7b267a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:30.790699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859c399-6590-4879-bd56-386c7b267a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:30.881059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859c399-6590-4879-bd56-386c7b267a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:30.882746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859c399-6590-4879-bd56-386c7b267a54 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:30.893880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 828/1656] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:31.106168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a7cb-35a9-4ae8-9bd0-95b325d73cf5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:31.154724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a7cb-35a9-4ae8-9bd0-95b325d73cf5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:31.181662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b948dd-173a-4be0-8e24-11c9ae854c83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:31.182689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b948dd-173a-4be0-8e24-11c9ae854c83 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:31.186122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b948dd-173a-4be0-8e24-11c9ae854c83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:31.187959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b948dd-173a-4be0-8e24-11c9ae854c83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:31.217458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b948dd-173a-4be0-8e24-11c9ae854c83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:31.219288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b948dd-173a-4be0-8e24-11c9ae854c83 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:31.263696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 829/1657] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:31.420368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859c399-6590-4879-bd56-386c7b267a54 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:31.430155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859c399-6590-4879-bd56-386c7b267a54 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:31.440211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37114ede-93af-4577-9c11-3ff8e3ecb995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:31.440540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37114ede-93af-4577-9c11-3ff8e3ecb995 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:31.440824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37114ede-93af-4577-9c11-3ff8e3ecb995 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:31.441099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37114ede-93af-4577-9c11-3ff8e3ecb995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:31.469858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37114ede-93af-4577-9c11-3ff8e3ecb995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:31.473447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37114ede-93af-4577-9c11-3ff8e3ecb995 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:31.494877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 829/1658] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:31.657999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b948dd-173a-4be0-8e24-11c9ae854c83 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:31.777472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b948dd-173a-4be0-8e24-11c9ae854c83 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:31.786273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:31.787149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:31.787429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:31.787701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] PATH_INFO: `/v3/users/b2791f0335c94665b07214993ab46638` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:31.788863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2791f0335c94665b07214993ab46638)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:31.791597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:31.829403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:32.025544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:32.062831 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2791f0335c94665b07214993ab46638'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:32.075657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2791f0335c94665b07214993ab46638'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:32.162389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2791f0335c94665b07214993ab46638'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:32.167186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2791f0335c94665b07214993ab46638'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:32.200410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2791f0335c94665b07214993ab46638'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:32.220721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 830/1659] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:41:31 2022] DELETE /identity/v3/users/b2791f0335c94665b07214993ab46638 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:32.227956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73027c86-3925-4769-8a58-37f54bfcf1c0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:32.227956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73027c86-3925-4769-8a58-37f54bfcf1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:32.227956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73027c86-3925-4769-8a58-37f54bfcf1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:32.262218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-73027c86-3925-4769-8a58-37f54bfcf1c0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:32.263494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-73027c86-3925-4769-8a58-37f54bfcf1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:32.371576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 830/1660] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:32.385735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:32.387304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:32.530865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0aa7-d23c-4c2e-b52c-47f4b888d770 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:32.537182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:32.538442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:32.539669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:32.539669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:32.567886 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:32.570522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:32.609105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 831/1661] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:33.811346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73027c86-3925-4769-8a58-37f54bfcf1c0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:33.812760 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-73027c86-3925-4769-8a58-37f54bfcf1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:34.017323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73027c86-3925-4769-8a58-37f54bfcf1c0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:34.021829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab8a4-9451-4bb5-b4e4-cadcef5bb19a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:34.022399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab8a4-9451-4bb5-b4e4-cadcef5bb19a service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:34.022734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab8a4-9451-4bb5-b4e4-cadcef5bb19a service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:34.023010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab8a4-9451-4bb5-b4e4-cadcef5bb19a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:34.032963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bb1ab8a4-9451-4bb5-b4e4-cadcef5bb19a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:34.169186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab8a4-9451-4bb5-b4e4-cadcef5bb19a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:34.170727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab8a4-9451-4bb5-b4e4-cadcef5bb19a service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:34.201317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 831/1662] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:34.847864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:34.851150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:34.893975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25d0eb-1c85-49fa-a37d-51802c9b660f service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:34.913598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:34.914542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:34.915100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:34.915521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] PATH_INFO: `/v3/projects/d9bd87e8826b4d4b8b0412c05dcc7c76` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:34.918928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9bd87e8826b4d4b8b0412c05dcc7c76)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:34.920386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: WARNING py.warnings [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:41:34.920386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: warnings.warn(msg) Aug 10 08:41:34.920386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: Aug 10 08:41:34.929290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:35.186632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9bd87e8826b4d4b8b0412c05dcc7c76', 'request_id': 'req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:35.203574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9bd87e8826b4d4b8b0412c05dcc7c76', 'request_id': 'req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:35.263928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9bd87e8826b4d4b8b0412c05dcc7c76', 'request_id': 'req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:35.431355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] The token cache is being invalidate because project d9bd87e8826b4d4b8b0412c05dcc7c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:41:35.432223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:35.433771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7868f8a6-0a3c-4bc9-8daf-61284e2133ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:35.439499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 832/1663] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:41:34 2022] DELETE /identity/v3/projects/d9bd87e8826b4d4b8b0412c05dcc7c76 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:35.441266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249c560-451c-4e14-8c23-96201557b85a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:35.442343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249c560-451c-4e14-8c23-96201557b85a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:35.442422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249c560-451c-4e14-8c23-96201557b85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:35.514313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8249c560-451c-4e14-8c23-96201557b85a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:35.516503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8249c560-451c-4e14-8c23-96201557b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:35.543584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:35.700334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c083-bdc9-45b6-8117-5e3c655bac3b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:35.700620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c083-bdc9-45b6-8117-5e3c655bac3b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:35.700975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c083-bdc9-45b6-8117-5e3c655bac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:35.702252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 832/1664] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:35.734013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-e791c083-bdc9-45b6-8117-5e3c655bac3b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:35.736105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e791c083-bdc9-45b6-8117-5e3c655bac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:35.746678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 833/1665] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:35.750733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249c560-451c-4e14-8c23-96201557b85a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:35.766386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249c560-451c-4e14-8c23-96201557b85a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:35.782626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:35.783016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:35.783309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:35.783574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:35.784392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:35.785078 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:35.803159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:35.863229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 833/1666] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:35.863404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c083-bdc9-45b6-8117-5e3c655bac3b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:35.886292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c083-bdc9-45b6-8117-5e3c655bac3b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:35.902538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150402a6-b5e2-4c17-9b7a-b7556a839cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:35.902538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150402a6-b5e2-4c17-9b7a-b7556a839cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:35.902538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150402a6-b5e2-4c17-9b7a-b7556a839cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:35.902917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150402a6-b5e2-4c17-9b7a-b7556a839cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:35.908263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150402a6-b5e2-4c17-9b7a-b7556a839cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:35.929409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150402a6-b5e2-4c17-9b7a-b7556a839cf2 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:35.970718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:36.089395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 834/1667] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:35 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:36.094036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:36.110220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eaa6b-6614-4828-bebb-49a27cd2f7c4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:36.247221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b54d7-75ed-4bcf-a714-acc65d0e0558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:36.247920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b54d7-75ed-4bcf-a714-acc65d0e0558 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:36.249620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b54d7-75ed-4bcf-a714-acc65d0e0558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:36.249953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b54d7-75ed-4bcf-a714-acc65d0e0558 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:36.250681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b54d7-75ed-4bcf-a714-acc65d0e0558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:36.252695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b54d7-75ed-4bcf-a714-acc65d0e0558 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:36.344007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150402a6-b5e2-4c17-9b7a-b7556a839cf2 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:36.344184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 834/1668] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:36 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:36.356318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150402a6-b5e2-4c17-9b7a-b7556a839cf2 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:36.363062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88674d-b4ee-4b24-be02-36ec670da492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:36.364255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88674d-b4ee-4b24-be02-36ec670da492 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:36.364687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88674d-b4ee-4b24-be02-36ec670da492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:36.365096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88674d-b4ee-4b24-be02-36ec670da492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:36.367122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88674d-b4ee-4b24-be02-36ec670da492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:36.368768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88674d-b4ee-4b24-be02-36ec670da492 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:36.381760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 835/1669] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:41:36.385421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b54d7-75ed-4bcf-a714-acc65d0e0558 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:36.397472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b54d7-75ed-4bcf-a714-acc65d0e0558 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:36.414296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd96047-b390-4db0-88b4-31794cf26f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:36.414296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd96047-b390-4db0-88b4-31794cf26f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:36.414296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd96047-b390-4db0-88b4-31794cf26f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:36.414296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd96047-b390-4db0-88b4-31794cf26f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:36.425246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd96047-b390-4db0-88b4-31794cf26f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:36.425246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd96047-b390-4db0-88b4-31794cf26f3e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:36.454167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 835/1670] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:36.454738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88674d-b4ee-4b24-be02-36ec670da492 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:36.477014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88674d-b4ee-4b24-be02-36ec670da492 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:36.499272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036c06e-86fc-4677-ad37-c1e6f918a00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:36.500442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c06e-86fc-4677-ad37-c1e6f918a00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:36.501462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c06e-86fc-4677-ad37-c1e6f918a00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:36.501851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c06e-86fc-4677-ad37-c1e6f918a00d admin admin] PATH_INFO: `/v3/projects/78ba8c579a3348f5b67d978c06c2ca8f/users/312c7f6c4bb1438f8a842c2ce9790aa6/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:36.544140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036c06e-86fc-4677-ad37-c1e6f918a00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ba8c579a3348f5b67d978c06c2ca8f, user_id=312c7f6c4bb1438f8a842c2ce9790aa6, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:36.549997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036c06e-86fc-4677-ad37-c1e6f918a00d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:36.644859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bfb65-1a73-422c-9963-1d4628789aac None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:36.645443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bfb65-1a73-422c-9963-1d4628789aac None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:36.646068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bfb65-1a73-422c-9963-1d4628789aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:36.680742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-849bfb65-1a73-422c-9963-1d4628789aac None None] MFA Rules not processed for user `527fdf5cf2af40c893b0e4ef9dc4e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:36.682056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-849bfb65-1a73-422c-9963-1d4628789aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:36.683788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 836/1671] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:36 2022] PUT /identity/v3/projects/78ba8c579a3348f5b67d978c06c2ca8f/users/312c7f6c4bb1438f8a842c2ce9790aa6/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:36.688006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe047c-e3cc-4fe2-b6c3-18aaeae8bb3b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:36.688338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe047c-e3cc-4fe2-b6c3-18aaeae8bb3b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:36.689006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe047c-e3cc-4fe2-b6c3-18aaeae8bb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:36.774710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f7fe047c-e3cc-4fe2-b6c3-18aaeae8bb3b None None] MFA Rules not processed for user `312c7f6c4bb1438f8a842c2ce9790aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:36.778205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f7fe047c-e3cc-4fe2-b6c3-18aaeae8bb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:36.878030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 836/1672] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:41:36.895449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d71c9-c653-4b66-a873-4a3e624a73e8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:36.895731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d71c9-c653-4b66-a873-4a3e624a73e8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:36.896018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d71c9-c653-4b66-a873-4a3e624a73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:36.910144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 837/1673] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:36.915781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe047c-e3cc-4fe2-b6c3-18aaeae8bb3b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:36.932457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3e8d71c9-c653-4b66-a873-4a3e624a73e8 None None] MFA Rules not processed for user `527fdf5cf2af40c893b0e4ef9dc4e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:36.933878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3e8d71c9-c653-4b66-a873-4a3e624a73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:36.955574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 837/1674] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:36.965401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d71c9-c653-4b66-a873-4a3e624a73e8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:36.971137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3e8d71c9-c653-4b66-a873-4a3e624a73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:36.981655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:37.047022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe047c-e3cc-4fe2-b6c3-18aaeae8bb3b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:37.053789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7083651-806a-459d-92b4-e8df7263d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:37.054407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7083651-806a-459d-92b4-e8df7263d927 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:37.055786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7083651-806a-459d-92b4-e8df7263d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:37.055786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7083651-806a-459d-92b4-e8df7263d927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:37.056571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7083651-806a-459d-92b4-e8df7263d927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:37.058775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7083651-806a-459d-92b4-e8df7263d927 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:37.106453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d71c9-c653-4b66-a873-4a3e624a73e8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:37.113265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593c09b-390d-4b90-b631-318307f3f92f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:37.114346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593c09b-390d-4b90-b631-318307f3f92f service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:37.114988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593c09b-390d-4b90-b631-318307f3f92f service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:37.115484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593c09b-390d-4b90-b631-318307f3f92f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:37.126343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593c09b-390d-4b90-b631-318307f3f92f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:37.129093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593c09b-390d-4b90-b631-318307f3f92f service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:37.153542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 838/1675] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:36 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:37.157436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7083651-806a-459d-92b4-e8df7263d927 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:37.165394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 838/1676] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:37.297652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:37.311767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7083651-806a-459d-92b4-e8df7263d927 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:37.318819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973807f-6ecd-4317-8caf-bf2c81fd9674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:37.319694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973807f-6ecd-4317-8caf-bf2c81fd9674 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:37.320038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973807f-6ecd-4317-8caf-bf2c81fd9674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:37.320415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973807f-6ecd-4317-8caf-bf2c81fd9674 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:37.321182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973807f-6ecd-4317-8caf-bf2c81fd9674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:37.323919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973807f-6ecd-4317-8caf-bf2c81fd9674 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:37.486517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 839/1677] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:37 2022] POST /identity/v3/users => generated 299 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:37.490336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593c09b-390d-4b90-b631-318307f3f92f service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:37.513441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593c09b-390d-4b90-b631-318307f3f92f service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:37.524573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b0fb4-4e01-4aa7-adb0-eb5a9e6c7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:37.525194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b0fb4-4e01-4aa7-adb0-eb5a9e6c7712 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:37.525470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b0fb4-4e01-4aa7-adb0-eb5a9e6c7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:37.525742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b0fb4-4e01-4aa7-adb0-eb5a9e6c7712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:37.526384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b0fb4-4e01-4aa7-adb0-eb5a9e6c7712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:37.528173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b0fb4-4e01-4aa7-adb0-eb5a9e6c7712 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:37.554228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 839/1678] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:37.558493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973807f-6ecd-4317-8caf-bf2c81fd9674 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:37.572715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973807f-6ecd-4317-8caf-bf2c81fd9674 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:37.586631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a693a-822b-4409-a67e-a0230aeba737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:37.587471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a693a-822b-4409-a67e-a0230aeba737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:37.587757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a693a-822b-4409-a67e-a0230aeba737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:37.588031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a693a-822b-4409-a67e-a0230aeba737 admin admin] PATH_INFO: `/v3/projects/473539ef7e20440cb1c8f6e79e89d431/users/9996b00e56af4a28ba7505cc7581004b/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:37.619854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a693a-822b-4409-a67e-a0230aeba737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473539ef7e20440cb1c8f6e79e89d431, user_id=9996b00e56af4a28ba7505cc7581004b, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:37.631224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a693a-822b-4409-a67e-a0230aeba737 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:37.698501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 840/1679] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:37 2022] PUT /identity/v3/projects/473539ef7e20440cb1c8f6e79e89d431/users/9996b00e56af4a28ba7505cc7581004b/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:37.702589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b0fb4-4e01-4aa7-adb0-eb5a9e6c7712 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:37.715032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b0fb4-4e01-4aa7-adb0-eb5a9e6c7712 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:37.864740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7326cb-cc08-427f-be84-901a46f7e3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:37.865364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7326cb-cc08-427f-be84-901a46f7e3ff admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:37.865642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7326cb-cc08-427f-be84-901a46f7e3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:37.865951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7326cb-cc08-427f-be84-901a46f7e3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:37.866699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7326cb-cc08-427f-be84-901a46f7e3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:37.870240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7326cb-cc08-427f-be84-901a46f7e3ff admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:37.902835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 840/1680] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:37.903804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a693a-822b-4409-a67e-a0230aeba737 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:37.918071 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a693a-822b-4409-a67e-a0230aeba737 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:37.932860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:37.934071 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:37.934862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:37.936015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] PATH_INFO: `/v3/projects/473539ef7e20440cb1c8f6e79e89d431/users/9996b00e56af4a28ba7505cc7581004b/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:37.940632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473539ef7e20440cb1c8f6e79e89d431, user_id=9996b00e56af4a28ba7505cc7581004b, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:37.948486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:37.990853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 841/1681] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:37 2022] PUT /identity/v3/projects/473539ef7e20440cb1c8f6e79e89d431/users/9996b00e56af4a28ba7505cc7581004b/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:37.994902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8081de-ed68-4ace-b1a8-608f2b357442 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:37.994902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8081de-ed68-4ace-b1a8-608f2b357442 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:37.995270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8081de-ed68-4ace-b1a8-608f2b357442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:38.075544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4a8081de-ed68-4ace-b1a8-608f2b357442 None None] MFA Rules not processed for user `9996b00e56af4a28ba7505cc7581004b`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:38.076812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4a8081de-ed68-4ace-b1a8-608f2b357442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:38.206851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:38.225485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 841/1682] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:38.504768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:38.509330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:38.513126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5ad3-8de9-46b7-ae33-1de9b04a9a5f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:38.513579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5ad3-8de9-46b7-ae33-1de9b04a9a5f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:38.513843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f5ad3-8de9-46b7-ae33-1de9b04a9a5f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:38.515879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 842/1683] 10.222.0.45 () {54 vars in 912 bytes} [Wed Aug 10 08:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:41:38.521782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e244-7756-4d19-96ae-e8c029c0b83a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:38.522140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e244-7756-4d19-96ae-e8c029c0b83a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:38.522534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e244-7756-4d19-96ae-e8c029c0b83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:38.590085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-33b8e244-7756-4d19-96ae-e8c029c0b83a None None] MFA Rules not processed for user `80c8c0985f6847368c4f7263b2bf8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:38.592254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-33b8e244-7756-4d19-96ae-e8c029c0b83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:38.677874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941eae4-5352-4302-a767-eeb9e8614752 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:38.688544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66e9ba-9a78-49a0-ab80-f0dc68ddba3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:38.688880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66e9ba-9a78-49a0-ab80-f0dc68ddba3e service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:38.693978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66e9ba-9a78-49a0-ab80-f0dc68ddba3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:38.693978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66e9ba-9a78-49a0-ab80-f0dc68ddba3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:38.714113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66e9ba-9a78-49a0-ab80-f0dc68ddba3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:38.715603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66e9ba-9a78-49a0-ab80-f0dc68ddba3e service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:38.742652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 843/1684] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:41:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:38.745055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 842/1685] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:38.794125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8e244-7756-4d19-96ae-e8c029c0b83a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:38.796414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-33b8e244-7756-4d19-96ae-e8c029c0b83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:38.813705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8e244-7756-4d19-96ae-e8c029c0b83a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:38.827644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:38.828266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:38.828545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:38.828814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:38.850988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:38.855348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:38.867449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 844/1686] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:38.922935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66e9ba-9a78-49a0-ab80-f0dc68ddba3e service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:39.093031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66e9ba-9a78-49a0-ab80-f0dc68ddba3e service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:39.106629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:39.107294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:39.107574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:39.107847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] PATH_INFO: `/v3/users/312c7f6c4bb1438f8a842c2ce9790aa6` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:39.109063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312c7f6c4bb1438f8a842c2ce9790aa6)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:39.115975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:39.198114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:39.200579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:39.220082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ad59-12eb-4a1d-b2d3-c588c4c003a9 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:39.227945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:39.228752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:39.229359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:39.232142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] PATH_INFO: `/v3/users/af781cc31545407d98675a0de1727b65` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:39.232928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af781cc31545407d98675a0de1727b65)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:39.234125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: WARNING py.warnings [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:41:39.234125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: warnings.warn(msg) Aug 10 08:41:39.234125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: Aug 10 08:41:39.236570 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:39.330936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:39.358443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312c7f6c4bb1438f8a842c2ce9790aa6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.386638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312c7f6c4bb1438f8a842c2ce9790aa6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.524419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312c7f6c4bb1438f8a842c2ce9790aa6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.525059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312c7f6c4bb1438f8a842c2ce9790aa6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.549265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-022b60d6-9a4a-43e4-b96d-e82e001ba108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312c7f6c4bb1438f8a842c2ce9790aa6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.574983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 843/1687] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:41:38 2022] DELETE /identity/v3/users/312c7f6c4bb1438f8a842c2ce9790aa6 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:39.579366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f24a0-43f4-41d7-8d01-d81e39d8c859 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:39.579516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af781cc31545407d98675a0de1727b65'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.580024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f24a0-43f4-41d7-8d01-d81e39d8c859 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:39.580024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f24a0-43f4-41d7-8d01-d81e39d8c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:39.617950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-550f24a0-43f4-41d7-8d01-d81e39d8c859 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:39.619506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-550f24a0-43f4-41d7-8d01-d81e39d8c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:39.662293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af781cc31545407d98675a0de1727b65'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.690625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af781cc31545407d98675a0de1727b65'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.751767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af781cc31545407d98675a0de1727b65'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.754483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbaa00ba-a099-40ad-ab4c-64436a6b6cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af781cc31545407d98675a0de1727b65'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:39.775535 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 845/1688] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:41:39 2022] DELETE /identity/v3/users/af781cc31545407d98675a0de1727b65 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:39.779811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbbe09-0ea4-4cd4-8cd1-b407baa01794 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:39.780090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbbe09-0ea4-4cd4-8cd1-b407baa01794 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:39.780357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbbe09-0ea4-4cd4-8cd1-b407baa01794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:39.783631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 844/1689] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:39.819414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d7fbbe09-0ea4-4cd4-8cd1-b407baa01794 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:39.820660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d7fbbe09-0ea4-4cd4-8cd1-b407baa01794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:39.884055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47179b-679a-4110-bc52-bcdfddc1052d None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:39.884575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47179b-679a-4110-bc52-bcdfddc1052d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:39.884984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47179b-679a-4110-bc52-bcdfddc1052d None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:39.886844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 845/1690] 10.222.0.45 () {54 vars in 961 bytes} [Wed Aug 10 08:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 08:41:39.894512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f312c-8c8e-4edd-a96a-10855135141c None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:39.895063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f312c-8c8e-4edd-a96a-10855135141c None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:39.895502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f312c-8c8e-4edd-a96a-10855135141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:39.927433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-823f312c-8c8e-4edd-a96a-10855135141c None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:39.929696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-823f312c-8c8e-4edd-a96a-10855135141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:39.960939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:39.994895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 846/1691] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:41:39.994895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbbe09-0ea4-4cd4-8cd1-b407baa01794 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:40.003370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d7fbbe09-0ea4-4cd4-8cd1-b407baa01794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:40.071693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 846/1692] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Aug 10 08:41:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:41:40.094378 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f312c-8c8e-4edd-a96a-10855135141c None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:40.095208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f312c-8c8e-4edd-a96a-10855135141c None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:40.112403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7640e5-a89a-4cb9-8e1c-d14016a517f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:40.113369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7640e5-a89a-4cb9-8e1c-d14016a517f9 service placement] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:40.113696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7640e5-a89a-4cb9-8e1c-d14016a517f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:40.114130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7640e5-a89a-4cb9-8e1c-d14016a517f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:40.119468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6a7640e5-a89a-4cb9-8e1c-d14016a517f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:40.139770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbbe09-0ea4-4cd4-8cd1-b407baa01794 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:40.144099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7354-a1d4-424c-9ecf-dd9164afa79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:40.145240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7354-a1d4-424c-9ecf-dd9164afa79d service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:40.145519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7354-a1d4-424c-9ecf-dd9164afa79d service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:40.145773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7354-a1d4-424c-9ecf-dd9164afa79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:40.149400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7640e5-a89a-4cb9-8e1c-d14016a517f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:40.156157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7640e5-a89a-4cb9-8e1c-d14016a517f9 service placement] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:40.167634 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b7354-a1d4-424c-9ecf-dd9164afa79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:40.169106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b7354-a1d4-424c-9ecf-dd9164afa79d service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:40.187334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 847/1693] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:40.188292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7354-a1d4-424c-9ecf-dd9164afa79d service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:40.201934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 847/1694] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:40.209068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7354-a1d4-424c-9ecf-dd9164afa79d service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:40.212908 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:40.213515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:40.213789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:40.214055 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:40.243343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:40.244798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:40.263312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 848/1695] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:41.295587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0320-223f-46a4-9643-9bf86766990c None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:41.296164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0320-223f-46a4-9643-9bf86766990c None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:41.296442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0320-223f-46a4-9643-9bf86766990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:41.402530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f4ef0320-223f-46a4-9643-9bf86766990c None None] MFA Rules not processed for user `661a67fbdd6941889c706d2560c920a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:41.404213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f4ef0320-223f-46a4-9643-9bf86766990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:41.445326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:41.579067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 848/1696] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:41.588999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:41.590652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:41.880774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948ed0-224d-435a-aa94-dc7627f30e79 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:41.893205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:41.894079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:41.899526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:41.899526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:41.918506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:41.920374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:41.953165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 849/1697] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:42.888965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0320-223f-46a4-9643-9bf86766990c None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:42.893182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f4ef0320-223f-46a4-9643-9bf86766990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:42.902113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:42.903597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:42.943939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4735e-f23e-4cf1-82b8-e4689352c1df service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:42.951227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0320-223f-46a4-9643-9bf86766990c None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:42.971080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:42.976028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:42.982649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:42.983657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:42.984118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:42.984566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:42.985027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] PATH_INFO: `/v3/projects/2bef42dd9b8f42b891b3d0621a300253` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:42.985484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] PATH_INFO: `/v3/projects/78ba8c579a3348f5b67d978c06c2ca8f` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:42.995550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bef42dd9b8f42b891b3d0621a300253)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:42.997223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ba8c579a3348f5b67d978c06c2ca8f)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:43.003532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:43.005126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:43.236203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bef42dd9b8f42b891b3d0621a300253', 'request_id': 'req-b625e20b-4acb-4411-98c1-e892fe98878b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.264355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ba8c579a3348f5b67d978c06c2ca8f', 'request_id': 'req-e3709a24-e9d8-4af5-b34c-e681768f94d2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.284883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ba8c579a3348f5b67d978c06c2ca8f', 'request_id': 'req-e3709a24-e9d8-4af5-b34c-e681768f94d2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.318130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ba8c579a3348f5b67d978c06c2ca8f', 'request_id': 'req-e3709a24-e9d8-4af5-b34c-e681768f94d2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.337331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bef42dd9b8f42b891b3d0621a300253', 'request_id': 'req-b625e20b-4acb-4411-98c1-e892fe98878b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.345572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bef42dd9b8f42b891b3d0621a300253', 'request_id': 'req-b625e20b-4acb-4411-98c1-e892fe98878b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.349131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:43.385623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] The token cache is being invalidate because project 2bef42dd9b8f42b891b3d0621a300253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:41:43.385919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.392941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.400210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 850/1698] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:41:42 2022] DELETE /identity/v3/projects/2bef42dd9b8f42b891b3d0621a300253 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:43.404801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:43.411161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:43.452054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] The token cache is being invalidate because project 78ba8c579a3348f5b67d978c06c2ca8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:41:43.452054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.453053 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.455725 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 849/1699] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:41:42 2022] DELETE /identity/v3/projects/78ba8c579a3348f5b67d978c06c2ca8f => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:43.460895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:43.463503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:43.576586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e20b-4acb-4411-98c1-e892fe98878b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:43.611456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3709a24-e9d8-4af5-b34c-e681768f94d2 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:43.629485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:43.629485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:43.629730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:43.629803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] PATH_INFO: `/v3/users/9996b00e56af4a28ba7505cc7581004b` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:43.633536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9996b00e56af4a28ba7505cc7581004b)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:43.635544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:43.729286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:43.730269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:43.730747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:43.733070 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] PATH_INFO: `/v3/users/498954aff1434c058b4a4d5f9eb9c48c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:43.735266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=498954aff1434c058b4a4d5f9eb9c48c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:43.737628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:43.968450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:43.971433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9996b00e56af4a28ba7505cc7581004b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:43.981559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9996b00e56af4a28ba7505cc7581004b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.056166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9996b00e56af4a28ba7505cc7581004b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.057060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9996b00e56af4a28ba7505cc7581004b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.061740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498954aff1434c058b4a4d5f9eb9c48c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.101957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3677a898-8074-40eb-899d-a3d624c653fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9996b00e56af4a28ba7505cc7581004b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.127341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498954aff1434c058b4a4d5f9eb9c48c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.143921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 850/1700] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:41:43 2022] DELETE /identity/v3/users/9996b00e56af4a28ba7505cc7581004b => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:41:44.145991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5c09-6ae5-4574-bb74-f0029e1782b6 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:44.147039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5c09-6ae5-4574-bb74-f0029e1782b6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:44.147501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5c09-6ae5-4574-bb74-f0029e1782b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:44.163897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498954aff1434c058b4a4d5f9eb9c48c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.212537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498954aff1434c058b4a4d5f9eb9c48c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.212537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7d258d02-ca45-4d27-815b-49dc4e679e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498954aff1434c058b4a4d5f9eb9c48c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:44.221693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4dbe5c09-6ae5-4574-bb74-f0029e1782b6 None None] MFA Rules not processed for user `d28b7a7b2e0143cf9ee6e761eb7fb281`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:44.223942 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4dbe5c09-6ae5-4574-bb74-f0029e1782b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:44.226394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 851/1701] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:41:43 2022] DELETE /identity/v3/users/498954aff1434c058b4a4d5f9eb9c48c => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:44.395268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ccbb-a6bb-4588-adcc-deea59049129 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:44.395792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ccbb-a6bb-4588-adcc-deea59049129 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:44.396228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ccbb-a6bb-4588-adcc-deea59049129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:44.397952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 851/1702] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:44.469148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9e53ccbb-a6bb-4588-adcc-deea59049129 None None] MFA Rules not processed for user `d28b7a7b2e0143cf9ee6e761eb7fb281`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:44.469708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9e53ccbb-a6bb-4588-adcc-deea59049129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:44.498104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 852/1703] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:41:44.500158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc54e13-77b5-4eab-aa49-9b26e10498e4 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:44.504580 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc54e13-77b5-4eab-aa49-9b26e10498e4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:44.509231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53ccbb-a6bb-4588-adcc-deea59049129 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:44.509864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc54e13-77b5-4eab-aa49-9b26e10498e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:44.515321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9e53ccbb-a6bb-4588-adcc-deea59049129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:44.578689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-cdc54e13-77b5-4eab-aa49-9b26e10498e4 None None] MFA Rules not processed for user `0c316e7b121b4d859d9677edcb49be45`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:44.580655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cdc54e13-77b5-4eab-aa49-9b26e10498e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:44.705594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 852/1704] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:44.713834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53ccbb-a6bb-4588-adcc-deea59049129 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:44.720855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:44.721747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:44.722493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:44.725175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:44.736480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:44.739198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:44.745541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:44.759968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 853/1705] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:41:44.873755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc54e13-77b5-4eab-aa49-9b26e10498e4 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:44.877853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cdc54e13-77b5-4eab-aa49-9b26e10498e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:44.927090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc54e13-77b5-4eab-aa49-9b26e10498e4 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:44.932907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:44.933532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:44.934444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:44.934626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:44.945645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:44.946874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:44.986442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 853/1706] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:45.215514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:45.218143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:45.298634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:45.300507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:45.372708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:45.382993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf26b54-6c93-4691-8ad9-e65fcab32564 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:45.389152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:45.389999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:45.394043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:45.394043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] PATH_INFO: `/v3/projects/473539ef7e20440cb1c8f6e79e89d431` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:45.403173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=473539ef7e20440cb1c8f6e79e89d431)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:45.405296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:45.446750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be30df1-75ab-493a-b0bd-ac41b8bd1474 service nova] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:45.462246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:45.464620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:45.465316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:45.465858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] PATH_INFO: `/v3/projects/478b5bc9a8fa4f9699dcc01b3d9fdccb` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:45.474656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478b5bc9a8fa4f9699dcc01b3d9fdccb)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:45.497487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:45.654608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478b5bc9a8fa4f9699dcc01b3d9fdccb', 'request_id': 'req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.673904 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478b5bc9a8fa4f9699dcc01b3d9fdccb', 'request_id': 'req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.683703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473539ef7e20440cb1c8f6e79e89d431', 'request_id': 'req-3c5923f1-8578-49e5-94a4-38a369fb15bd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.687114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478b5bc9a8fa4f9699dcc01b3d9fdccb', 'request_id': 'req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.818766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] The token cache is being invalidate because project 478b5bc9a8fa4f9699dcc01b3d9fdccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:41:45.819217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.820449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a45ff8fa-f398-4822-a2e1-f60202cdd0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.823390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 854/1707] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:41:45 2022] DELETE /identity/v3/projects/478b5bc9a8fa4f9699dcc01b3d9fdccb => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:41:45.828836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ab352-904c-49f9-af40-bf2e3e997fa4 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:45.829335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ab352-904c-49f9-af40-bf2e3e997fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:45.830166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ab352-904c-49f9-af40-bf2e3e997fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:45.859162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-861ab352-904c-49f9-af40-bf2e3e997fa4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:45.861443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-861ab352-904c-49f9-af40-bf2e3e997fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:45.907105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473539ef7e20440cb1c8f6e79e89d431', 'request_id': 'req-3c5923f1-8578-49e5-94a4-38a369fb15bd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.917360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473539ef7e20440cb1c8f6e79e89d431', 'request_id': 'req-3c5923f1-8578-49e5-94a4-38a369fb15bd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.961061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] The token cache is being invalidate because project 473539ef7e20440cb1c8f6e79e89d431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:41:45.961346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.963858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3c5923f1-8578-49e5-94a4-38a369fb15bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:45.971627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 854/1708] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:41:45 2022] DELETE /identity/v3/projects/473539ef7e20440cb1c8f6e79e89d431 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:45.976639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7344-d1c5-4869-9a8b-144ec0fd2c90 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:45.976845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7344-d1c5-4869-9a8b-144ec0fd2c90 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:45.977125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7344-d1c5-4869-9a8b-144ec0fd2c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.024488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 855/1709] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:46.029028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f52a7344-d1c5-4869-9a8b-144ec0fd2c90 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:46.032876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f52a7344-d1c5-4869-9a8b-144ec0fd2c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:46.037785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964d9d-f3e9-44e3-af66-91b4c7d24df9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.038341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964d9d-f3e9-44e3-af66-91b4c7d24df9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.038829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964d9d-f3e9-44e3-af66-91b4c7d24df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.054213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 855/1710] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:46.055884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072c61-229c-4fb4-a7ce-fa1907970f8b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.056169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072c61-229c-4fb4-a7ce-fa1907970f8b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.056442 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62072c61-229c-4fb4-a7ce-fa1907970f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.087029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-62072c61-229c-4fb4-a7ce-fa1907970f8b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:46.088747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-62072c61-229c-4fb4-a7ce-fa1907970f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:46.092654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-76964d9d-f3e9-44e3-af66-91b4c7d24df9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:46.094689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-76964d9d-f3e9-44e3-af66-91b4c7d24df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:46.098122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 856/1711] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:46.102415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62072c61-229c-4fb4-a7ce-fa1907970f8b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:46.114950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62072c61-229c-4fb4-a7ce-fa1907970f8b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:46.140910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 856/1712] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:46.146035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76964d9d-f3e9-44e3-af66-91b4c7d24df9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:46.158913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76964d9d-f3e9-44e3-af66-91b4c7d24df9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:46.165365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:46.166016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.168518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.168893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.169578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:46.169886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:46.175327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:46.191553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:46.192360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.192686 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.192965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.193632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:41:46.197497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:46.199589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:46.204436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 857/1713] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:46.210693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:46.212301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:46.258267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 857/1714] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:41:46.264735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960a97-700d-4137-9261-98461c5ea3d7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:46.266574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:46.292622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420de33-8a74-42ab-a59d-054b85aafc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:46.293267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420de33-8a74-42ab-a59d-054b85aafc87 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.293555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420de33-8a74-42ab-a59d-054b85aafc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.293811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420de33-8a74-42ab-a59d-054b85aafc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.294448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420de33-8a74-42ab-a59d-054b85aafc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:46.298654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dea5a-7163-4c45-b8d3-cd4be2210722 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:46.298814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420de33-8a74-42ab-a59d-054b85aafc87 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:46.310641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff6cb3-ffab-4537-b8ba-bd99bc5a30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:46.311333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff6cb3-ffab-4537-b8ba-bd99bc5a30c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.311614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff6cb3-ffab-4537-b8ba-bd99bc5a30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.311895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff6cb3-ffab-4537-b8ba-bd99bc5a30c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.312672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff6cb3-ffab-4537-b8ba-bd99bc5a30c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:46.314788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff6cb3-ffab-4537-b8ba-bd99bc5a30c5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:46.420320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 858/1715] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:46 2022] POST /identity/v3/projects => generated 409 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:46.423259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 858/1716] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:46 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:46.425151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420de33-8a74-42ab-a59d-054b85aafc87 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:46.429228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff6cb3-ffab-4537-b8ba-bd99bc5a30c5 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:46.559258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:46.597206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420de33-8a74-42ab-a59d-054b85aafc87 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:46.726679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff6cb3-ffab-4537-b8ba-bd99bc5a30c5 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:46.740290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14283a36-14fa-422a-81f4-b2a9106d20d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:46.741406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14283a36-14fa-422a-81f4-b2a9106d20d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.741925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14283a36-14fa-422a-81f4-b2a9106d20d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.742326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14283a36-14fa-422a-81f4-b2a9106d20d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.743165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14283a36-14fa-422a-81f4-b2a9106d20d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:46.752498 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14283a36-14fa-422a-81f4-b2a9106d20d6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:46.778504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6a920-e747-4fb9-afb1-8a11dfd3c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:46.778504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6a920-e747-4fb9-afb1-8a11dfd3c63f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.783408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6a920-e747-4fb9-afb1-8a11dfd3c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.788636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6a920-e747-4fb9-afb1-8a11dfd3c63f admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.789439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6a920-e747-4fb9-afb1-8a11dfd3c63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:46.791804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6a920-e747-4fb9-afb1-8a11dfd3c63f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:46.937961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 859/1717] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:46 2022] POST /identity/v3/users => generated 283 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:46.940304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35839b7-cd3f-40e0-b7d6-58ffb97d1a72 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.940778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35839b7-cd3f-40e0-b7d6-58ffb97d1a72 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.942021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35839b7-cd3f-40e0-b7d6-58ffb97d1a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:46.972129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-e35839b7-cd3f-40e0-b7d6-58ffb97d1a72 None None] MFA Rules not processed for user `d28b7a7b2e0143cf9ee6e761eb7fb281`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:46.973767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e35839b7-cd3f-40e0-b7d6-58ffb97d1a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:46.993781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 859/1718] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:46 2022] POST /identity/v3/users => generated 305 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:46.995476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdd94c-a59e-4ec9-b29f-852f6ebeb0ba None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:46.996159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdd94c-a59e-4ec9-b29f-852f6ebeb0ba None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:46.996731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdd94c-a59e-4ec9-b29f-852f6ebeb0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.075448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 860/1719] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:47.080975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35839b7-cd3f-40e0-b7d6-58ffb97d1a72 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.090421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-91cdd94c-a59e-4ec9-b29f-852f6ebeb0ba None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:47.092300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-91cdd94c-a59e-4ec9-b29f-852f6ebeb0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:47.093204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35839b7-cd3f-40e0-b7d6-58ffb97d1a72 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:47.098622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471cc85-4237-4035-887e-05af6a5aff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:47.099588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471cc85-4237-4035-887e-05af6a5aff02 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.100083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471cc85-4237-4035-887e-05af6a5aff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.100541 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471cc85-4237-4035-887e-05af6a5aff02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.101383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471cc85-4237-4035-887e-05af6a5aff02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:47.103237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471cc85-4237-4035-887e-05af6a5aff02 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:47.119710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 861/1720] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:47.120933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471cc85-4237-4035-887e-05af6a5aff02 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.133733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471cc85-4237-4035-887e-05af6a5aff02 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:47.140766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288437c-d638-49ac-8922-108eaab09171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:47.141793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288437c-d638-49ac-8922-108eaab09171 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.142326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288437c-d638-49ac-8922-108eaab09171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.142674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288437c-d638-49ac-8922-108eaab09171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.144016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288437c-d638-49ac-8922-108eaab09171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:47.147248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288437c-d638-49ac-8922-108eaab09171 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:47.162868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 862/1721] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:47.164762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288437c-d638-49ac-8922-108eaab09171 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.177448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288437c-d638-49ac-8922-108eaab09171 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:47.183913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9677-e4b5-4b86-a713-19508de94849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:47.184662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9677-e4b5-4b86-a713-19508de94849 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.184944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9677-e4b5-4b86-a713-19508de94849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.185467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9677-e4b5-4b86-a713-19508de94849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.186377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d9677-e4b5-4b86-a713-19508de94849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:47.188310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d9677-e4b5-4b86-a713-19508de94849 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:47.207016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 863/1722] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:47.208449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9677-e4b5-4b86-a713-19508de94849 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.229859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9677-e4b5-4b86-a713-19508de94849 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:47.236986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b083-4c4e-4ce6-9505-82beb2a099c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:47.242127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b083-4c4e-4ce6-9505-82beb2a099c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.242883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b083-4c4e-4ce6-9505-82beb2a099c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.243366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b083-4c4e-4ce6-9505-82beb2a099c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.244873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478b083-4c4e-4ce6-9505-82beb2a099c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:47.247227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478b083-4c4e-4ce6-9505-82beb2a099c1 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:47.260636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 864/1723] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:47.261147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 860/1724] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:47.262152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b083-4c4e-4ce6-9505-82beb2a099c1 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.264817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdd94c-a59e-4ec9-b29f-852f6ebeb0ba None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.289739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b083-4c4e-4ce6-9505-82beb2a099c1 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:47.295428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdd94c-a59e-4ec9-b29f-852f6ebeb0ba None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:47.296339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92ba0-6858-4251-bb6d-fd2e233d2036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:47.297405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92ba0-6858-4251-bb6d-fd2e233d2036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.298070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92ba0-6858-4251-bb6d-fd2e233d2036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.298527 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92ba0-6858-4251-bb6d-fd2e233d2036 admin admin] PATH_INFO: `/v3/projects/bfd0edb306e549ccb3b00746d6e88a6e/users/dceb24a805974a76ab4c39faf814cd9a/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.301933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72b473-9e26-46fb-a17e-ce4ef885ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:47.302896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b473-9e26-46fb-a17e-ce4ef885ee74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.303384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b473-9e26-46fb-a17e-ce4ef885ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.304100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b473-9e26-46fb-a17e-ce4ef885ee74 admin admin] PATH_INFO: `/v3/projects/7245bce03b794343952052f6f36db9f5/users/8ed5224823ad4e52b8ac1672d72d4bc9/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.322691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92ba0-6858-4251-bb6d-fd2e233d2036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd0edb306e549ccb3b00746d6e88a6e, user_id=dceb24a805974a76ab4c39faf814cd9a, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:47.323159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72b473-9e26-46fb-a17e-ce4ef885ee74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7245bce03b794343952052f6f36db9f5, user_id=8ed5224823ad4e52b8ac1672d72d4bc9, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:47.326862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92ba0-6858-4251-bb6d-fd2e233d2036 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:47.327809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72b473-9e26-46fb-a17e-ce4ef885ee74 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:47.447181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 861/1725] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:47 2022] PUT /identity/v3/projects/7245bce03b794343952052f6f36db9f5/users/8ed5224823ad4e52b8ac1672d72d4bc9/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:41:47.459646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b07db-400c-4fb3-8b69-03e16c3e8cf2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.460177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b07db-400c-4fb3-8b69-03e16c3e8cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.460304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 865/1726] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:47 2022] PUT /identity/v3/projects/bfd0edb306e549ccb3b00746d6e88a6e/users/dceb24a805974a76ab4c39faf814cd9a/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:47.470212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b07db-400c-4fb3-8b69-03e16c3e8cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.473272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8c0e-9a17-405d-a9b9-ed3db958cbb0 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.473561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8c0e-9a17-405d-a9b9-ed3db958cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.473833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8c0e-9a17-405d-a9b9-ed3db958cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.510237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-929b07db-400c-4fb3-8b69-03e16c3e8cf2 None None] MFA Rules not processed for user `8ed5224823ad4e52b8ac1672d72d4bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:47.511666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-929b07db-400c-4fb3-8b69-03e16c3e8cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:47.554416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-da3e8c0e-9a17-405d-a9b9-ed3db958cbb0 None None] MFA Rules not processed for user `dceb24a805974a76ab4c39faf814cd9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:47.555689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-da3e8c0e-9a17-405d-a9b9-ed3db958cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:47.590894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:47.614235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 862/1727] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:47 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:47.617873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b07db-400c-4fb3-8b69-03e16c3e8cf2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.730002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 866/1728] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:47.731604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8c0e-9a17-405d-a9b9-ed3db958cbb0 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.736380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-da3e8c0e-9a17-405d-a9b9-ed3db958cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:47.772206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b07db-400c-4fb3-8b69-03e16c3e8cf2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:47.781496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a75ad-11a0-405c-92cf-b6dfe2e24c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:47.782459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a75ad-11a0-405c-92cf-b6dfe2e24c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:47.783021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a75ad-11a0-405c-92cf-b6dfe2e24c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:47.783550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a75ad-11a0-405c-92cf-b6dfe2e24c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:47.784804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a75ad-11a0-405c-92cf-b6dfe2e24c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:47.801233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a75ad-11a0-405c-92cf-b6dfe2e24c0e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:47.918090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 863/1729] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:47 2022] POST /identity/v3/projects => generated 407 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:41:47.919370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a75ad-11a0-405c-92cf-b6dfe2e24c0e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:47.976950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8c0e-9a17-405d-a9b9-ed3db958cbb0 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:48.013423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:48.103511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a75ad-11a0-405c-92cf-b6dfe2e24c0e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:48.111001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80012dee-017b-4ef4-86ff-6259cd0ad2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:48.111759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80012dee-017b-4ef4-86ff-6259cd0ad2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:48.111887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80012dee-017b-4ef4-86ff-6259cd0ad2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:48.112168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80012dee-017b-4ef4-86ff-6259cd0ad2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:48.113179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80012dee-017b-4ef4-86ff-6259cd0ad2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:48.115180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80012dee-017b-4ef4-86ff-6259cd0ad2d0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:48.120250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552f5d-91b7-4749-87b1-76e1754e5abf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:48.121627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552f5d-91b7-4749-87b1-76e1754e5abf service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:48.122190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552f5d-91b7-4749-87b1-76e1754e5abf service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:48.122904 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f552f5d-91b7-4749-87b1-76e1754e5abf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:48.236529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 864/1730] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:41:47 2022] POST /identity/v3/projects => generated 367 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:48.237486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80012dee-017b-4ef4-86ff-6259cd0ad2d0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:48.297182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f552f5d-91b7-4749-87b1-76e1754e5abf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:48.302077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f552f5d-91b7-4749-87b1-76e1754e5abf service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:48.340570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 867/1731] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:41:48.343015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552f5d-91b7-4749-87b1-76e1754e5abf service swift] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:48.381383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f552f5d-91b7-4749-87b1-76e1754e5abf service swift] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:48.421171 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:48.463975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80012dee-017b-4ef4-86ff-6259cd0ad2d0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:48.488742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea558-ca1b-4ff5-a274-0f6933717797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:48.488742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea558-ca1b-4ff5-a274-0f6933717797 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:48.488742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea558-ca1b-4ff5-a274-0f6933717797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:48.488742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cea558-ca1b-4ff5-a274-0f6933717797 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:48.489106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cea558-ca1b-4ff5-a274-0f6933717797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:48.496949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cea558-ca1b-4ff5-a274-0f6933717797 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:48.637709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45313f-c5af-4f8b-b588-0c64e95082fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:48.638708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45313f-c5af-4f8b-b588-0c64e95082fc admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:48.639614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45313f-c5af-4f8b-b588-0c64e95082fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:48.640061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45313f-c5af-4f8b-b588-0c64e95082fc admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:48.640864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45313f-c5af-4f8b-b588-0c64e95082fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:48.645266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45313f-c5af-4f8b-b588-0c64e95082fc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:48.724033 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 865/1732] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:48 2022] POST /identity/v3/users => generated 310 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:48.725595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea558-ca1b-4ff5-a274-0f6933717797 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:48.744940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cea558-ca1b-4ff5-a274-0f6933717797 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:48.764255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71651008-ed6c-444b-b45b-d6842e7b8623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:48.765765 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651008-ed6c-444b-b45b-d6842e7b8623 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:48.766308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651008-ed6c-444b-b45b-d6842e7b8623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:48.766753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651008-ed6c-444b-b45b-d6842e7b8623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:48.767593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71651008-ed6c-444b-b45b-d6842e7b8623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:48.770844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71651008-ed6c-444b-b45b-d6842e7b8623 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:48.797416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 866/1733] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:48.799958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b44db-a8b1-4871-a8d5-e233883f1b71 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:48.822600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 868/1734] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:41:48 2022] POST /identity/v3/users => generated 290 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:41:48.823475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45313f-c5af-4f8b-b588-0c64e95082fc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:48.826429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b44db-a8b1-4871-a8d5-e233883f1b71 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:48.834927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b44db-a8b1-4871-a8d5-e233883f1b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:48.908737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45313f-c5af-4f8b-b588-0c64e95082fc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:49.038337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b064392-6fe6-4682-a844-0be8ddbaab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:49.038337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064392-6fe6-4682-a844-0be8ddbaab40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:49.038337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064392-6fe6-4682-a844-0be8ddbaab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:49.038337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064392-6fe6-4682-a844-0be8ddbaab40 admin admin] PATH_INFO: `/v3/projects/9ed3b9baf2104e0dbb07bf1b41603a15/users/ed71d201cd294476b52e69aff12dba42/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:49.040082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-934b44db-a8b1-4871-a8d5-e233883f1b71 None None] MFA Rules not processed for user `661a67fbdd6941889c706d2560c920a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:49.040082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-934b44db-a8b1-4871-a8d5-e233883f1b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:49.069475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b064392-6fe6-4682-a844-0be8ddbaab40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed3b9baf2104e0dbb07bf1b41603a15, user_id=ed71d201cd294476b52e69aff12dba42, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:49.072948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b064392-6fe6-4682-a844-0be8ddbaab40 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:49.160552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 869/1735] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:48 2022] PUT /identity/v3/projects/9ed3b9baf2104e0dbb07bf1b41603a15/users/ed71d201cd294476b52e69aff12dba42/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:49.169536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b064392-6fe6-4682-a844-0be8ddbaab40 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:49.258240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:49.287060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 867/1736] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:49.292212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e8a3-5d08-49a1-9d2d-a741dc05ccf6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:49.292954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e8a3-5d08-49a1-9d2d-a741dc05ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:49.294205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e8a3-5d08-49a1-9d2d-a741dc05ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:49.419314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b064392-6fe6-4682-a844-0be8ddbaab40 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:49.426419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9f27e8a3-5d08-49a1-9d2d-a741dc05ccf6 None None] MFA Rules not processed for user `80c8c0985f6847368c4f7263b2bf8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:49.432714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9f27e8a3-5d08-49a1-9d2d-a741dc05ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:49.433362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175920cd-c3c3-4797-8b6d-bc924240deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:49.434155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175920cd-c3c3-4797-8b6d-bc924240deda admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:49.436173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175920cd-c3c3-4797-8b6d-bc924240deda admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:49.436607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175920cd-c3c3-4797-8b6d-bc924240deda admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:49.437504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175920cd-c3c3-4797-8b6d-bc924240deda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:49.452376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175920cd-c3c3-4797-8b6d-bc924240deda admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:49.475836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 870/1737] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:49.477472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175920cd-c3c3-4797-8b6d-bc924240deda admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:49.504852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175920cd-c3c3-4797-8b6d-bc924240deda admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:49.515647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8844-e340-481d-8b21-3fd14eb7e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:49.516492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8844-e340-481d-8b21-3fd14eb7e327 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:49.516940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8844-e340-481d-8b21-3fd14eb7e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:49.517559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8844-e340-481d-8b21-3fd14eb7e327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:49.518367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8844-e340-481d-8b21-3fd14eb7e327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:49.520752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8844-e340-481d-8b21-3fd14eb7e327 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:49.546261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 871/1738] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:49.547326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8844-e340-481d-8b21-3fd14eb7e327 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:49.577087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8844-e340-481d-8b21-3fd14eb7e327 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:49.593887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:49.594900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:49.595664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:49.596195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] PATH_INFO: `/v3/projects/16ce6afa133b4f5f8e1fcda32f84344c/users/058d243fb5b74875b5189cc0057ad861/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:49.654086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ce6afa133b4f5f8e1fcda32f84344c, user_id=058d243fb5b74875b5189cc0057ad861, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:49.657475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:49.662260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 868/1739] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Aug 10 08:41:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:49.663542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27e8a3-5d08-49a1-9d2d-a741dc05ccf6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:49.736797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27e8a3-5d08-49a1-9d2d-a741dc05ccf6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:49.739717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:49.751150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:49.752695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:49.753290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:49.754590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] PATH_INFO: `/v3/projects/9ed3b9baf2104e0dbb07bf1b41603a15/users/ed71d201cd294476b52e69aff12dba42/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:49.759112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed3b9baf2104e0dbb07bf1b41603a15, user_id=ed71d201cd294476b52e69aff12dba42, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:49.772928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:49.798718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 869/1740] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:49 2022] PUT /identity/v3/projects/9ed3b9baf2104e0dbb07bf1b41603a15/users/ed71d201cd294476b52e69aff12dba42/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:49.800889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:49.807331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:49.818529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 872/1741] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:49 2022] PUT /identity/v3/projects/16ce6afa133b4f5f8e1fcda32f84344c/users/058d243fb5b74875b5189cc0057ad861/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:49.819626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:49.825506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:49.983731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d50d79-7a51-46ea-b370-560eee699f46 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:50.006644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:50.101532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409685e9-5cd6-402d-a87e-0b1072e64253 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:50.112777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ac78-86d5-4948-8f7b-1fecac083e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:50.115059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ac78-86d5-4948-8f7b-1fecac083e99 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:50.115556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ac78-86d5-4948-8f7b-1fecac083e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:50.115940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ac78-86d5-4948-8f7b-1fecac083e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:50.129794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3ac78-86d5-4948-8f7b-1fecac083e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:50.131472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3ac78-86d5-4948-8f7b-1fecac083e99 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:50.143175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 873/1742] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:50.150579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e6ca3-0811-4e77-b7c3-6ccace5c793e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:50.157311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e6ca3-0811-4e77-b7c3-6ccace5c793e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:50.160316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:50.160316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:50.160724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:50.160894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:50.167106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e6ca3-0811-4e77-b7c3-6ccace5c793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:50.172059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:50.296467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a07e6ca3-0811-4e77-b7c3-6ccace5c793e None None] MFA Rules not processed for user `ed71d201cd294476b52e69aff12dba42`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:50.307758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a07e6ca3-0811-4e77-b7c3-6ccace5c793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:50.443493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 874/1743] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:50 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:50.444544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e6ca3-0811-4e77-b7c3-6ccace5c793e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:50.462734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:50.464277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:50.509186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 870/1744] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:50.521074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:50.521074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:50.552126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e6ca3-0811-4e77-b7c3-6ccace5c793e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:50.558398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855c039-27dc-447c-bb56-242a219f92be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:50.559338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855c039-27dc-447c-bb56-242a219f92be admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:50.559782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855c039-27dc-447c-bb56-242a219f92be admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:50.560249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855c039-27dc-447c-bb56-242a219f92be admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:50.561135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855c039-27dc-447c-bb56-242a219f92be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:50.563156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855c039-27dc-447c-bb56-242a219f92be admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:50.583954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c127df2-b1d3-4887-a779-f983170ffb80 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:50.584549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 875/1745] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:41:50.590188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855c039-27dc-447c-bb56-242a219f92be admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:50.602990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41672fd-8c97-471d-9c73-10fd8dddf66f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:50.603663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41672fd-8c97-471d-9c73-10fd8dddf66f service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:50.603941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41672fd-8c97-471d-9c73-10fd8dddf66f service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:50.605022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41672fd-8c97-471d-9c73-10fd8dddf66f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:50.626836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41672fd-8c97-471d-9c73-10fd8dddf66f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:50.627373 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855c039-27dc-447c-bb56-242a219f92be admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:50.631385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41672fd-8c97-471d-9c73-10fd8dddf66f service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:50.685614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eef1e2-23c0-4fe7-a064-34fbe9a8c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:50.685614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eef1e2-23c0-4fe7-a064-34fbe9a8c645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:50.685614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eef1e2-23c0-4fe7-a064-34fbe9a8c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:50.685614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eef1e2-23c0-4fe7-a064-34fbe9a8c645 admin admin] PATH_INFO: `/v3/projects/16ce6afa133b4f5f8e1fcda32f84344c/users/058d243fb5b74875b5189cc0057ad861/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:50.687068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eef1e2-23c0-4fe7-a064-34fbe9a8c645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ce6afa133b4f5f8e1fcda32f84344c, user_id=058d243fb5b74875b5189cc0057ad861, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:50.687068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eef1e2-23c0-4fe7-a064-34fbe9a8c645 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:50.687335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 871/1746] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:50 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:50.687435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 876/1747] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:41:50 2022] PUT /identity/v3/projects/16ce6afa133b4f5f8e1fcda32f84344c/users/058d243fb5b74875b5189cc0057ad861/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:50.696682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1365-9afc-463c-af9a-bb126e74be98 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:50.697215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1365-9afc-463c-af9a-bb126e74be98 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:50.697720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1365-9afc-463c-af9a-bb126e74be98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:50.756184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cf4a1365-9afc-463c-af9a-bb126e74be98 None None] MFA Rules not processed for user `058d243fb5b74875b5189cc0057ad861`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:50.764354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cf4a1365-9afc-463c-af9a-bb126e74be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:50.885184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:51.012116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 872/1748] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:51.225578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd1d13-7f01-48fc-b337-6174407e1cb5 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:51.226366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd1d13-7f01-48fc-b337-6174407e1cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:51.226960 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd1d13-7f01-48fc-b337-6174407e1cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:51.310014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-57dd1d13-7f01-48fc-b337-6174407e1cb5 None None] MFA Rules not processed for user `0c316e7b121b4d859d9677edcb49be45`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:51.313547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-57dd1d13-7f01-48fc-b337-6174407e1cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:51.405980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1365-9afc-463c-af9a-bb126e74be98 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:51.408401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:51.521151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 877/1749] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:51.582904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1365-9afc-463c-af9a-bb126e74be98 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:51.601047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d25667-7bc6-479a-bd42-2efc319556b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:51.601047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d25667-7bc6-479a-bd42-2efc319556b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:51.601047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d25667-7bc6-479a-bd42-2efc319556b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:51.601047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d25667-7bc6-479a-bd42-2efc319556b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:51.623775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d25667-7bc6-479a-bd42-2efc319556b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:51.625147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d25667-7bc6-479a-bd42-2efc319556b7 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:51.653975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 873/1750] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:51.914644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd1d13-7f01-48fc-b337-6174407e1cb5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:51.954223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd1d13-7f01-48fc-b337-6174407e1cb5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:51.968412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb91f-cd19-4a04-b8a0-6c5426497c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:51.974608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb91f-cd19-4a04-b8a0-6c5426497c73 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:51.974608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb91f-cd19-4a04-b8a0-6c5426497c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:51.974608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb91f-cd19-4a04-b8a0-6c5426497c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:52.195124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eb91f-cd19-4a04-b8a0-6c5426497c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:52.198902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eb91f-cd19-4a04-b8a0-6c5426497c73 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:52.215950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 878/1751] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:51 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:52.972279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849ad8-d012-4899-b22b-e75dc1439870 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:52.976894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849ad8-d012-4899-b22b-e75dc1439870 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:52.976894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84849ad8-d012-4899-b22b-e75dc1439870 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:52.976894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 874/1752] 10.222.0.45 () {54 vars in 912 bytes} [Wed Aug 10 08:41:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:41:52.981925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7f77-3754-47c7-bd3b-8ec1e4b3355d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:52.982520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7f77-3754-47c7-bd3b-8ec1e4b3355d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:52.982520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7f77-3754-47c7-bd3b-8ec1e4b3355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:53.030546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f1ab7f77-3754-47c7-bd3b-8ec1e4b3355d None None] MFA Rules not processed for user `80c8c0985f6847368c4f7263b2bf8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:53.031991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f1ab7f77-3754-47c7-bd3b-8ec1e4b3355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:53.232147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 879/1753] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:41:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:41:53.334842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84849ad8-d012-4899-b22b-e75dc1439870 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:53.376967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84849ad8-d012-4899-b22b-e75dc1439870 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:53.393018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7a7e3-a6f9-48a5-a919-05ec9590471b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:53.396121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7a7e3-a6f9-48a5-a919-05ec9590471b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:53.398292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7a7e3-a6f9-48a5-a919-05ec9590471b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:53.398977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7a7e3-a6f9-48a5-a919-05ec9590471b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:53.432044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7a7e3-a6f9-48a5-a919-05ec9590471b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:53.442261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7a7e3-a6f9-48a5-a919-05ec9590471b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:53.483090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 875/1754] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:53.743039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7f77-3754-47c7-bd3b-8ec1e4b3355d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:53.772934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7f77-3754-47c7-bd3b-8ec1e4b3355d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:53.785574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71717de-7970-4581-98c6-c5fbd146455e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:53.786693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71717de-7970-4581-98c6-c5fbd146455e service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:53.787038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71717de-7970-4581-98c6-c5fbd146455e service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:53.787583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71717de-7970-4581-98c6-c5fbd146455e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:54.013883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71717de-7970-4581-98c6-c5fbd146455e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:54.017302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71717de-7970-4581-98c6-c5fbd146455e service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:54.053633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 880/1755] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:54.456641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7f433-cd61-49d3-b66d-a1035b6bf2cb None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:54.457702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7f433-cd61-49d3-b66d-a1035b6bf2cb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:54.458175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7f433-cd61-49d3-b66d-a1035b6bf2cb None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:54.463183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 876/1756] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:41:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:41:54.541388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560880-4746-4286-990f-0713318a4c27 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:54.542347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560880-4746-4286-990f-0713318a4c27 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:54.542824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560880-4746-4286-990f-0713318a4c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:54.611697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b1560880-4746-4286-990f-0713318a4c27 None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:54.624741 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b1560880-4746-4286-990f-0713318a4c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:54.694539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:54.807344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 881/1757] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:41:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:55.227660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7f433-cd61-49d3-b66d-a1035b6bf2cb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:55.229825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1bf7f433-cd61-49d3-b66d-a1035b6bf2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:55.323067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7f433-cd61-49d3-b66d-a1035b6bf2cb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:55.370168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047774a3-4e39-4aa1-a4c0-3b5688144850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:55.373307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047774a3-4e39-4aa1-a4c0-3b5688144850 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:55.373803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047774a3-4e39-4aa1-a4c0-3b5688144850 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:55.377584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047774a3-4e39-4aa1-a4c0-3b5688144850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:55.417107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047774a3-4e39-4aa1-a4c0-3b5688144850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:55.422825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047774a3-4e39-4aa1-a4c0-3b5688144850 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:55.500891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 877/1758] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:55.552183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1560880-4746-4286-990f-0713318a4c27 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:55.555408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b1560880-4746-4286-990f-0713318a4c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:55.775773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1560880-4746-4286-990f-0713318a4c27 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:55.784312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:55.786441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:55.786441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:55.786441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] PATH_INFO: `/v3/users/10be10e09f104b35a596ba3f56e98a65` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:55.794681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10be10e09f104b35a596ba3f56e98a65)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:55.794681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:56.205529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10be10e09f104b35a596ba3f56e98a65'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:56.248023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10be10e09f104b35a596ba3f56e98a65'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:56.323993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10be10e09f104b35a596ba3f56e98a65'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:56.324673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10be10e09f104b35a596ba3f56e98a65'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:56.350011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10be10e09f104b35a596ba3f56e98a65'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:56.381147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 882/1759] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:41:55 2022] DELETE /identity/v3/users/10be10e09f104b35a596ba3f56e98a65 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:56.386594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d128-462a-46e6-b245-d76fdc5c37fc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:56.386724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d128-462a-46e6-b245-d76fdc5c37fc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:56.387339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6d128-462a-46e6-b245-d76fdc5c37fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:56.470631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3ac6d128-462a-46e6-b245-d76fdc5c37fc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:56.472086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3ac6d128-462a-46e6-b245-d76fdc5c37fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:56.636612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 878/1760] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:56.821998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:56.824075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:56.950195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:56.981590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ef745-73a5-4bf4-add4-b79e77932b6f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:56.990325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d41de-aa6d-450e-bdea-8a0c04431c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:56.991270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d41de-aa6d-450e-bdea-8a0c04431c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:56.992422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d41de-aa6d-450e-bdea-8a0c04431c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:56.993132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d41de-aa6d-450e-bdea-8a0c04431c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:57.005987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d41de-aa6d-450e-bdea-8a0c04431c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:57.008676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d41de-aa6d-450e-bdea-8a0c04431c6f service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:57.040227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 883/1761] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:57.932257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6d128-462a-46e6-b245-d76fdc5c37fc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:57.933904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3ac6d128-462a-46e6-b245-d76fdc5c37fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:57.947857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6d128-462a-46e6-b245-d76fdc5c37fc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:57.959784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:57.959784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:57.959784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:57.959784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] PATH_INFO: `/v3/projects/3e4e527caeca4745b17978c83760553e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:57.960125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4e527caeca4745b17978c83760553e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:57.960125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:58.125000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:58.138148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4e527caeca4745b17978c83760553e', 'request_id': 'req-fb78e015-5df6-44e4-ad6c-40013683bfe1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.255536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4e527caeca4745b17978c83760553e', 'request_id': 'req-fb78e015-5df6-44e4-ad6c-40013683bfe1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.266030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4e527caeca4745b17978c83760553e', 'request_id': 'req-fb78e015-5df6-44e4-ad6c-40013683bfe1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.284747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] The token cache is being invalidate because project 3e4e527caeca4745b17978c83760553e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:41:58.285248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.287032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fb78e015-5df6-44e4-ad6c-40013683bfe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.293627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d41de-aa6d-450e-bdea-8a0c04431c6f service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:58.311452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 879/1762] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:41:57 2022] DELETE /identity/v3/projects/3e4e527caeca4745b17978c83760553e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:58.319280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d41de-aa6d-450e-bdea-8a0c04431c6f service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:58.401776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:58.409034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:58.409855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:58.410327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] PATH_INFO: `/v3/users/df9c3a9c5c1146d2a20c743e0d979cae` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:58.412452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9c3a9c5c1146d2a20c743e0d979cae)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:58.415106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:58.682456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9c3a9c5c1146d2a20c743e0d979cae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.694750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9c3a9c5c1146d2a20c743e0d979cae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.786060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9c3a9c5c1146d2a20c743e0d979cae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.786060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9c3a9c5c1146d2a20c743e0d979cae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.808190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d2501ccf-53bd-44ca-955c-03e8d99b8dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9c3a9c5c1146d2a20c743e0d979cae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:58.822512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 884/1763] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:41:58 2022] DELETE /identity/v3/users/df9c3a9c5c1146d2a20c743e0d979cae => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:59.050300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298534-fba7-4b8d-b9d3-640e1e009d15 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:59.056596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298534-fba7-4b8d-b9d3-640e1e009d15 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:59.056596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298534-fba7-4b8d-b9d3-640e1e009d15 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:59.057499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 880/1764] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:41:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:41:59.064256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a52ca-5f13-4062-a555-20efe2d50a43 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:59.064786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a52ca-5f13-4062-a555-20efe2d50a43 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:59.065076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a52ca-5f13-4062-a555-20efe2d50a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:59.114540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8e3a52ca-5f13-4062-a555-20efe2d50a43 None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:59.118499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8e3a52ca-5f13-4062-a555-20efe2d50a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:59.238331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 885/1765] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:41:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:41:59.260086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23298534-fba7-4b8d-b9d3-640e1e009d15 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:59.262885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-23298534-fba7-4b8d-b9d3-640e1e009d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:59.293724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23298534-fba7-4b8d-b9d3-640e1e009d15 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:59.316644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1843f9-1d40-4d01-84e8-d5acf4c9dc36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:59.317612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1843f9-1d40-4d01-84e8-d5acf4c9dc36 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:59.318324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1843f9-1d40-4d01-84e8-d5acf4c9dc36 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:59.318822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1843f9-1d40-4d01-84e8-d5acf4c9dc36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:59.346226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1843f9-1d40-4d01-84e8-d5acf4c9dc36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:59.349723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1843f9-1d40-4d01-84e8-d5acf4c9dc36 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:59.380289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 881/1766] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:41:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:41:59.579742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a52ca-5f13-4062-a555-20efe2d50a43 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:59.579742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8e3a52ca-5f13-4062-a555-20efe2d50a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:59.599938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:59.702042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a52ca-5f13-4062-a555-20efe2d50a43 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:41:59.708339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:41:59.709201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:59.709552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:59.709895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] PATH_INFO: `/v3/projects/c48eb292c41648ab8a21e91c880fa055` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:59.711275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48eb292c41648ab8a21e91c880fa055)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:41:59.725204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:41:59.829736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48eb292c41648ab8a21e91c880fa055', 'request_id': 'req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:59.838421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48eb292c41648ab8a21e91c880fa055', 'request_id': 'req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:59.846431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48eb292c41648ab8a21e91c880fa055', 'request_id': 'req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:59.958775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] The token cache is being invalidate because project c48eb292c41648ab8a21e91c880fa055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:41:59.959195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:59.959838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:41:59.961339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 886/1767] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:41:59 2022] DELETE /identity/v3/projects/c48eb292c41648ab8a21e91c880fa055 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:41:59.966388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65837d8b-9ba1-48ce-a311-4b42587920d8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:41:59.966734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65837d8b-9ba1-48ce-a311-4b42587920d8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:41:59.967854 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65837d8b-9ba1-48ce-a311-4b42587920d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:41:59.970592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:41:59.971969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:41:59.995754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-65837d8b-9ba1-48ce-a311-4b42587920d8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:41:59.996986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-65837d8b-9ba1-48ce-a311-4b42587920d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:00.047566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf3af-8938-4ffd-8fdd-f7fb0535366a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:00.053199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:00.053830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.054766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.055038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] PATH_INFO: `/v3/users/5896dac87ac84f99adfffedec7c63a70` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.056196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5896dac87ac84f99adfffedec7c63a70)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:00.058087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:00.072575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 882/1768] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:00.076066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aadd52-c7bc-4987-ad0c-1e814e4ba9ac None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.076386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aadd52-c7bc-4987-ad0c-1e814e4ba9ac None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.076608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aadd52-c7bc-4987-ad0c-1e814e4ba9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.096479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-63aadd52-c7bc-4987-ad0c-1e814e4ba9ac None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:00.097715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-63aadd52-c7bc-4987-ad0c-1e814e4ba9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:00.105490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 883/1769] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:00.109559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aadd52-c7bc-4987-ad0c-1e814e4ba9ac None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:00.118894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aadd52-c7bc-4987-ad0c-1e814e4ba9ac None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:00.123446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:00.130566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.130566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.130566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.130566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:00.130566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:00.130566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:00.138779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 884/1770] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:42:00.143290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:00.152999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bcd94-7713-4e0b-a087-76c0bd287060 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:00.157697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e4fb7-0613-4914-97e2-04076817a8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:00.161043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4fb7-0613-4914-97e2-04076817a8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.161043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4fb7-0613-4914-97e2-04076817a8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.161043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4fb7-0613-4914-97e2-04076817a8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.161043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e4fb7-0613-4914-97e2-04076817a8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:00.161656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e4fb7-0613-4914-97e2-04076817a8f2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:00.290934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 885/1771] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:00 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:00.295046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e4fb7-0613-4914-97e2-04076817a8f2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:00.320357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5896dac87ac84f99adfffedec7c63a70'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:00.327284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5896dac87ac84f99adfffedec7c63a70'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:00.356213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e4fb7-0613-4914-97e2-04076817a8f2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:00.360950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:00.361552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.361827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.362095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.363271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:00.365242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:00.397773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5896dac87ac84f99adfffedec7c63a70'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:00.398495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5896dac87ac84f99adfffedec7c63a70'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:00.413017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-632ad8ee-ea59-4213-8b72-6d68562232a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5896dac87ac84f99adfffedec7c63a70'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:00.419297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 887/1772] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:41:59 2022] DELETE /identity/v3/users/5896dac87ac84f99adfffedec7c63a70 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:00.423518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4622f-67a9-4e46-af6e-5bb8b5d56b6b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.423903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4622f-67a9-4e46-af6e-5bb8b5d56b6b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.424235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4622f-67a9-4e46-af6e-5bb8b5d56b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.443699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-cad4622f-67a9-4e46-af6e-5bb8b5d56b6b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:00.444908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cad4622f-67a9-4e46-af6e-5bb8b5d56b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:00.445468 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:00.450899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 886/1773] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:00 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:00.454936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:00.456791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:00.468802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779a14d-4ddc-4f13-a09a-2ba074b936b8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:00.510435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 888/1774] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:00.526967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4622f-67a9-4e46-af6e-5bb8b5d56b6b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:00.529516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cad4622f-67a9-4e46-af6e-5bb8b5d56b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:00.567915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ed724-035e-4ff2-9344-2bd040b78bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:00.568640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ed724-035e-4ff2-9344-2bd040b78bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.568991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ed724-035e-4ff2-9344-2bd040b78bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.569332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ed724-035e-4ff2-9344-2bd040b78bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.570057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ed724-035e-4ff2-9344-2bd040b78bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:00.571799 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ed724-035e-4ff2-9344-2bd040b78bf0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:00.587112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 887/1775] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:00.591455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ed724-035e-4ff2-9344-2bd040b78bf0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:00.604949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4622f-67a9-4e46-af6e-5bb8b5d56b6b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:00.607990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ed724-035e-4ff2-9344-2bd040b78bf0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:00.609186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534f2c-2b5e-40e8-a041-c095dde6bd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:00.609843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534f2c-2b5e-40e8-a041-c095dde6bd8c service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.610188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534f2c-2b5e-40e8-a041-c095dde6bd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.610577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534f2c-2b5e-40e8-a041-c095dde6bd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.613751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5d43-6c4d-4af7-9544-344d023a2710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:00.614369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5d43-6c4d-4af7-9544-344d023a2710 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.614704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5d43-6c4d-4af7-9544-344d023a2710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.614961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5d43-6c4d-4af7-9544-344d023a2710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.615606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd5d43-6c4d-4af7-9544-344d023a2710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:00.617192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd5d43-6c4d-4af7-9544-344d023a2710 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:00.621687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534f2c-2b5e-40e8-a041-c095dde6bd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:00.623734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534f2c-2b5e-40e8-a041-c095dde6bd8c service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:00.630761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 888/1776] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:00.632412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5d43-6c4d-4af7-9544-344d023a2710 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:00.634156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 889/1777] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:00.643090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5d43-6c4d-4af7-9544-344d023a2710 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:00.648026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a00-17f4-4268-8c1d-a8e1a1c0fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:00.648706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a00-17f4-4268-8c1d-a8e1a1c0fd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.648988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a00-17f4-4268-8c1d-a8e1a1c0fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.649262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a00-17f4-4268-8c1d-a8e1a1c0fd08 admin admin] PATH_INFO: `/v3/projects/47b6285add714b40b33c2f9223d92752/users/72c9a29f748b4e5db5268c0c8a1e700b/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.665493 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d764a00-17f4-4268-8c1d-a8e1a1c0fd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b6285add714b40b33c2f9223d92752, user_id=72c9a29f748b4e5db5268c0c8a1e700b, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:00.668001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d764a00-17f4-4268-8c1d-a8e1a1c0fd08 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:00.795318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 889/1778] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:00 2022] PUT /identity/v3/projects/47b6285add714b40b33c2f9223d92752/users/72c9a29f748b4e5db5268c0c8a1e700b/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:00.805997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536910d-14ed-423d-8b4d-80be298194a1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:00.806282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536910d-14ed-423d-8b4d-80be298194a1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:00.806589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536910d-14ed-423d-8b4d-80be298194a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:00.848233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-2536910d-14ed-423d-8b4d-80be298194a1 None None] MFA Rules not processed for user `72c9a29f748b4e5db5268c0c8a1e700b`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:00.850243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2536910d-14ed-423d-8b4d-80be298194a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:00.942419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 890/1779] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:00.947954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a00-17f4-4268-8c1d-a8e1a1c0fd08 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.039020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a00-17f4-4268-8c1d-a8e1a1c0fd08 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:01.050651 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:01.050651 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.050651 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.050651 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.051669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:01.051669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:01.138204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 890/1780] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:00 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:01.139574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536910d-14ed-423d-8b4d-80be298194a1 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.155026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536910d-14ed-423d-8b4d-80be298194a1 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:01.214101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe0b82-e3ea-45be-a426-7f8fe767e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:01.214732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe0b82-e3ea-45be-a426-7f8fe767e1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.215014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe0b82-e3ea-45be-a426-7f8fe767e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.215289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe0b82-e3ea-45be-a426-7f8fe767e1cc admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.215912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe0b82-e3ea-45be-a426-7f8fe767e1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:01.217821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe0b82-e3ea-45be-a426-7f8fe767e1cc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:01.274068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.275934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:01.288845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bfae2-06fb-4b67-87cf-a8266ac829d0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:01.293730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:01.294380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.294701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.294983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] PATH_INFO: `/v3/projects/51d8d2cc1d264271a7665300db502bbb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.296417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d8d2cc1d264271a7665300db502bbb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:01.298695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:01.345519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 891/1781] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:01 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:01.349642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe0b82-e3ea-45be-a426-7f8fe767e1cc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.362861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe0b82-e3ea-45be-a426-7f8fe767e1cc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:01.368002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edf01-11d9-48f1-91e8-1a9363635983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:01.372113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edf01-11d9-48f1-91e8-1a9363635983 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.372113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edf01-11d9-48f1-91e8-1a9363635983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.372113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edf01-11d9-48f1-91e8-1a9363635983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.372113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edf01-11d9-48f1-91e8-1a9363635983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:01.372113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edf01-11d9-48f1-91e8-1a9363635983 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:01.382821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 892/1782] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:01.387106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edf01-11d9-48f1-91e8-1a9363635983 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.409415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edf01-11d9-48f1-91e8-1a9363635983 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:01.416618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b9fc-99ef-42d4-93cb-f7ea93d5c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:01.417297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b9fc-99ef-42d4-93cb-f7ea93d5c87f admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.417582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b9fc-99ef-42d4-93cb-f7ea93d5c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.417858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b9fc-99ef-42d4-93cb-f7ea93d5c87f admin admin] PATH_INFO: `/v3/projects/dd981ca937c540ca9a94750702c5d193/users/4d9ccddcf9d54fe48c4363351a9e97dc/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.444757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b9fc-99ef-42d4-93cb-f7ea93d5c87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd981ca937c540ca9a94750702c5d193, user_id=4d9ccddcf9d54fe48c4363351a9e97dc, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:01.448064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b9fc-99ef-42d4-93cb-f7ea93d5c87f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:01.475044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d8d2cc1d264271a7665300db502bbb', 'request_id': 'req-f25f05fa-976e-49a8-a044-d7b37cafa19a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:01.534810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 893/1783] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:01 2022] PUT /identity/v3/projects/dd981ca937c540ca9a94750702c5d193/users/4d9ccddcf9d54fe48c4363351a9e97dc/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:01.536652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b9fc-99ef-42d4-93cb-f7ea93d5c87f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.552553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d8d2cc1d264271a7665300db502bbb', 'request_id': 'req-f25f05fa-976e-49a8-a044-d7b37cafa19a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:01.565379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d8d2cc1d264271a7665300db502bbb', 'request_id': 'req-f25f05fa-976e-49a8-a044-d7b37cafa19a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:01.567762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:01.596228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] The token cache is being invalidate because project 51d8d2cc1d264271a7665300db502bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:01.596507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:01.597369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:01.600240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 891/1784] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:01 2022] DELETE /identity/v3/projects/51d8d2cc1d264271a7665300db502bbb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:01.604550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.612136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:01.661772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b9fc-99ef-42d4-93cb-f7ea93d5c87f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:01.666646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:01.667265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.667544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.667845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.668504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:01.670145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:01.691106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 894/1785] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:01.694767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.696867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:01.711628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f05fa-976e-49a8-a044-d7b37cafa19a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:01.715855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514e80-3a58-4fdd-8aef-58d8014e2d0d admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:01.717370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:01.718089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.718387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.718771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] PATH_INFO: `/v3/users/0d7354d60fc0469ea94f1a38df352ab9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.719910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7354d60fc0469ea94f1a38df352ab9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:01.721976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:01.723398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd56e4e-da8c-403b-adce-185cc93c2114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:01.736201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56e4e-da8c-403b-adce-185cc93c2114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.736201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56e4e-da8c-403b-adce-185cc93c2114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.736201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56e4e-da8c-403b-adce-185cc93c2114 admin admin] PATH_INFO: `/v3/projects/dd981ca937c540ca9a94750702c5d193/users/4d9ccddcf9d54fe48c4363351a9e97dc/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.736201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd56e4e-da8c-403b-adce-185cc93c2114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd981ca937c540ca9a94750702c5d193, user_id=4d9ccddcf9d54fe48c4363351a9e97dc, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:01.736201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd56e4e-da8c-403b-adce-185cc93c2114 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:01.746313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 895/1786] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:01 2022] PUT /identity/v3/projects/dd981ca937c540ca9a94750702c5d193/users/4d9ccddcf9d54fe48c4363351a9e97dc/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:01.759118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5b1d-068b-46b1-8469-b51601fe39bc None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:01.759540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5b1d-068b-46b1-8469-b51601fe39bc None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:01.759907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5b1d-068b-46b1-8469-b51601fe39bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:01.816290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-002d5b1d-068b-46b1-8469-b51601fe39bc None None] MFA Rules not processed for user `4d9ccddcf9d54fe48c4363351a9e97dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:01.816290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-002d5b1d-068b-46b1-8469-b51601fe39bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:01.900315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 896/1787] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:01.913458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d5b1d-068b-46b1-8469-b51601fe39bc None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:01.915301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-002d5b1d-068b-46b1-8469-b51601fe39bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:02.011671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d5b1d-068b-46b1-8469-b51601fe39bc None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:02.011671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10256-7cbc-430d-95c8-6e9648c46490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:02.011671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10256-7cbc-430d-95c8-6e9648c46490 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:02.011671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10256-7cbc-430d-95c8-6e9648c46490 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:02.012893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10256-7cbc-430d-95c8-6e9648c46490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:02.012893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e10256-7cbc-430d-95c8-6e9648c46490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:02.012893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e10256-7cbc-430d-95c8-6e9648c46490 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:02.022659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 897/1788] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:02.533005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7354d60fc0469ea94f1a38df352ab9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:02.547346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:02.718525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7354d60fc0469ea94f1a38df352ab9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:02.726925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7354d60fc0469ea94f1a38df352ab9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:02.740178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7354d60fc0469ea94f1a38df352ab9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:02.741726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7354d60fc0469ea94f1a38df352ab9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:02.753680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 892/1789] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:01 2022] DELETE /identity/v3/users/0d7354d60fc0469ea94f1a38df352ab9 => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:03.096433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:03.635153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10256-7cbc-430d-95c8-6e9648c46490 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:03.753593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10256-7cbc-430d-95c8-6e9648c46490 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:03.849338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:03.849338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:03.849338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:03.849338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] PATH_INFO: `/v3/projects/45a39f01895c4b06a2dc4fdd9b214245` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:03.849783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a39f01895c4b06a2dc4fdd9b214245)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:03.852849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:04.028078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a39f01895c4b06a2dc4fdd9b214245', 'request_id': 'req-91bff6bc-5e46-4e6a-bc76-41326a3315ab'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.032452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a39f01895c4b06a2dc4fdd9b214245', 'request_id': 'req-91bff6bc-5e46-4e6a-bc76-41326a3315ab'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.044512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a39f01895c4b06a2dc4fdd9b214245', 'request_id': 'req-91bff6bc-5e46-4e6a-bc76-41326a3315ab'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.141129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] The token cache is being invalidate because project 45a39f01895c4b06a2dc4fdd9b214245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:04.164867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.164867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.164867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 898/1790] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:03 2022] DELETE /identity/v3/projects/45a39f01895c4b06a2dc4fdd9b214245 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:04.168184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:04.169868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:04.185611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cae50-de65-45d9-b415-8356e3ea182b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:04.243329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:04.268545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:04.269641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:04.270083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:04.270352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] PATH_INFO: `/v3/users/c8ae15a0c0f54fdcb48b3ac2044ba187` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:04.271782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ae15a0c0f54fdcb48b3ac2044ba187)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:04.273761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:04.542843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:04.542843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:04.572769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bff6bc-5e46-4e6a-bc76-41326a3315ab admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:04.605118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:04.612782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:04.612782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:04.612782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] PATH_INFO: `/v3/users/dceb24a805974a76ab4c39faf814cd9a` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:04.613905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dceb24a805974a76ab4c39faf814cd9a)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:04.615323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ae15a0c0f54fdcb48b3ac2044ba187'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.619889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:04.695397 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ae15a0c0f54fdcb48b3ac2044ba187'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.710083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ae15a0c0f54fdcb48b3ac2044ba187'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.744421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ae15a0c0f54fdcb48b3ac2044ba187'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.745536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bd4bcd9-50e0-4541-8db8-fb63bc597991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ae15a0c0f54fdcb48b3ac2044ba187'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.753915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 893/1791] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:04 2022] DELETE /identity/v3/users/c8ae15a0c0f54fdcb48b3ac2044ba187 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:04.901887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dceb24a805974a76ab4c39faf814cd9a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.910943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dceb24a805974a76ab4c39faf814cd9a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.986891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dceb24a805974a76ab4c39faf814cd9a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:04.987945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dceb24a805974a76ab4c39faf814cd9a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:05.006847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dceb24a805974a76ab4c39faf814cd9a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:05.026765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 899/1792] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:04 2022] DELETE /identity/v3/users/dceb24a805974a76ab4c39faf814cd9a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:05.029999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1078e4-66bc-4175-921a-fd41f40c26f2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:05.030361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1078e4-66bc-4175-921a-fd41f40c26f2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:05.030754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1078e4-66bc-4175-921a-fd41f40c26f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:05.050728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dc1078e4-66bc-4175-921a-fd41f40c26f2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:05.052168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dc1078e4-66bc-4175-921a-fd41f40c26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:05.146720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 894/1793] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:05.159022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:05.166513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:05.237681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1c873-dafa-4944-af1c-68d35c2dd890 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:05.241801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a489d2-b5c6-4d71-909d-22a6d89ff721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:05.242416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a489d2-b5c6-4d71-909d-22a6d89ff721 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:05.242726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a489d2-b5c6-4d71-909d-22a6d89ff721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:05.242999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a489d2-b5c6-4d71-909d-22a6d89ff721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:05.255555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a489d2-b5c6-4d71-909d-22a6d89ff721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:05.257080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a489d2-b5c6-4d71-909d-22a6d89ff721 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:05.272336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 900/1794] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:05.416993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1078e4-66bc-4175-921a-fd41f40c26f2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:05.420211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dc1078e4-66bc-4175-921a-fd41f40c26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:05.431572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1078e4-66bc-4175-921a-fd41f40c26f2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:05.437239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:05.438105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:05.438388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:05.438697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] PATH_INFO: `/v3/projects/b987673c4dd04bf7a0850dd669874bad` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:05.440864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b987673c4dd04bf7a0850dd669874bad)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:05.442974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:05.586245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b987673c4dd04bf7a0850dd669874bad', 'request_id': 'req-cb172aa8-6aca-4e94-978f-2b1e95c40e13'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:05.666716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b987673c4dd04bf7a0850dd669874bad', 'request_id': 'req-cb172aa8-6aca-4e94-978f-2b1e95c40e13'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:05.678531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b987673c4dd04bf7a0850dd669874bad', 'request_id': 'req-cb172aa8-6aca-4e94-978f-2b1e95c40e13'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:05.696767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:05.702200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] The token cache is being invalidate because project b987673c4dd04bf7a0850dd669874bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:05.709486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:05.709486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb172aa8-6aca-4e94-978f-2b1e95c40e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:05.709486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 895/1795] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:05 2022] DELETE /identity/v3/projects/b987673c4dd04bf7a0850dd669874bad => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:05.711553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3ee0-844a-486f-aeed-96eab0b96201 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:05.712076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3ee0-844a-486f-aeed-96eab0b96201 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:05.712353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3ee0-844a-486f-aeed-96eab0b96201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:05.734669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-699c3ee0-844a-486f-aeed-96eab0b96201 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:05.736099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-699c3ee0-844a-486f-aeed-96eab0b96201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:05.797402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 901/1796] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:05.806305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9e69b-e454-450e-8884-df0c265812c8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:05.806749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9e69b-e454-450e-8884-df0c265812c8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:05.807034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9e69b-e454-450e-8884-df0c265812c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:05.829798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7aa9e69b-e454-450e-8884-df0c265812c8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:05.831607 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7aa9e69b-e454-450e-8884-df0c265812c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:05.845755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 896/1797] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:05.852722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3ee0-844a-486f-aeed-96eab0b96201 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:05.857175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9e69b-e454-450e-8884-df0c265812c8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:05.860291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7aa9e69b-e454-450e-8884-df0c265812c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:05.863027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3ee0-844a-486f-aeed-96eab0b96201 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:05.874138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:05.875084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:05.875622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:05.877291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:05.877291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:05.877291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:05.877547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9e69b-e454-450e-8884-df0c265812c8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:05.880941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:05.882632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:05.883348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:05.883722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:05.884054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] PATH_INFO: `/v3/projects/bfd0edb306e549ccb3b00746d6e88a6e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:05.885276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd0edb306e549ccb3b00746d6e88a6e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:05.887466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:05.894989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 902/1798] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:05.899846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:05.915710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb723-e1a7-42bd-95b1-e45022a191dc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:05.929322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d45ab-c16e-4d0f-ac63-ef2149a28ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:05.930460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d45ab-c16e-4d0f-ac63-ef2149a28ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:05.932380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d45ab-c16e-4d0f-ac63-ef2149a28ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:05.932836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d45ab-c16e-4d0f-ac63-ef2149a28ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:05.934204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d45ab-c16e-4d0f-ac63-ef2149a28ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:05.939405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d45ab-c16e-4d0f-ac63-ef2149a28ed5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:06.093123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd0edb306e549ccb3b00746d6e88a6e', 'request_id': 'req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.093240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 903/1799] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:05 2022] POST /identity/v3/projects => generated 401 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:06.098156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d45ab-c16e-4d0f-ac63-ef2149a28ed5 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:06.176106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d45ab-c16e-4d0f-ac63-ef2149a28ed5 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:06.183844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:06.183844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.183844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.183844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.184173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:06.184173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:06.186093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd0edb306e549ccb3b00746d6e88a6e', 'request_id': 'req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.194922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd0edb306e549ccb3b00746d6e88a6e', 'request_id': 'req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.206885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] The token cache is being invalidate because project bfd0edb306e549ccb3b00746d6e88a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:06.207173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.208120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.210121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 897/1800] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:05 2022] DELETE /identity/v3/projects/bfd0edb306e549ccb3b00746d6e88a6e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:06.214432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:06.216280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:06.282583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5e8fb-b0b0-44d3-8ca1-b3dac391bc1b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:06.288459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:06.289135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.289414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.289690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] PATH_INFO: `/v3/users/058d243fb5b74875b5189cc0057ad861` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.290863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=058d243fb5b74875b5189cc0057ad861)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:06.292867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:06.295585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 904/1801] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:06 2022] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:06.300168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:06.302697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:06.315294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877b77e-d092-4c97-9a53-0ae994331c85 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:06.322929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd3cc8-f597-4e83-8ce1-fe5535ce79e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:06.324244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3cc8-f597-4e83-8ce1-fe5535ce79e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.324244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3cc8-f597-4e83-8ce1-fe5535ce79e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.324244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3cc8-f597-4e83-8ce1-fe5535ce79e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.324795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd3cc8-f597-4e83-8ce1-fe5535ce79e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:06.326413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd3cc8-f597-4e83-8ce1-fe5535ce79e5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:06.338602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 905/1802] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:06.351757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd3cc8-f597-4e83-8ce1-fe5535ce79e5 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:06.362141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd3cc8-f597-4e83-8ce1-fe5535ce79e5 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:06.366726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d076f-21d6-4d36-b156-77fefa76eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:06.368894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d076f-21d6-4d36-b156-77fefa76eb2b admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.368894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d076f-21d6-4d36-b156-77fefa76eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.368894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d076f-21d6-4d36-b156-77fefa76eb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.368894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d076f-21d6-4d36-b156-77fefa76eb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:06.370136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d076f-21d6-4d36-b156-77fefa76eb2b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:06.380438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 906/1803] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:06.384425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d076f-21d6-4d36-b156-77fefa76eb2b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:06.395857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d076f-21d6-4d36-b156-77fefa76eb2b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:06.400812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10700d07-1929-4307-8410-982d9c11124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:06.401448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10700d07-1929-4307-8410-982d9c11124c admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.401725 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10700d07-1929-4307-8410-982d9c11124c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.402023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10700d07-1929-4307-8410-982d9c11124c admin admin] PATH_INFO: `/v3/projects/1d6565d6658640f7b4c0d434c6e0ae9e/users/6a95a7bb8fbf457da4e981a4e50627c3/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.417026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10700d07-1929-4307-8410-982d9c11124c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6565d6658640f7b4c0d434c6e0ae9e, user_id=6a95a7bb8fbf457da4e981a4e50627c3, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:06.419755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10700d07-1929-4307-8410-982d9c11124c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:06.500957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 907/1804] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:06 2022] PUT /identity/v3/projects/1d6565d6658640f7b4c0d434c6e0ae9e/users/6a95a7bb8fbf457da4e981a4e50627c3/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:06.510408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058d243fb5b74875b5189cc0057ad861'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.515380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38e93-94c8-4942-a545-214bb89eb2e1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.515380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38e93-94c8-4942-a545-214bb89eb2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.515380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38e93-94c8-4942-a545-214bb89eb2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.541750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-deb38e93-94c8-4942-a545-214bb89eb2e1 None None] MFA Rules not processed for user `6a95a7bb8fbf457da4e981a4e50627c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:06.543997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-deb38e93-94c8-4942-a545-214bb89eb2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:06.606253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 908/1805] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:06 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:06.610668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb38e93-94c8-4942-a545-214bb89eb2e1 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:06.620945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058d243fb5b74875b5189cc0057ad861'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.633409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058d243fb5b74875b5189cc0057ad861'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.647306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058d243fb5b74875b5189cc0057ad861'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.648278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058d243fb5b74875b5189cc0057ad861'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:06.658733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 898/1806] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:06 2022] DELETE /identity/v3/users/058d243fb5b74875b5189cc0057ad861 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:06.698633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb38e93-94c8-4942-a545-214bb89eb2e1 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:06.760261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:06.760948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.761273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.761545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.762215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:06.764104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:06.766416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:06.768168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:06.782356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26b0d-9673-489b-950f-b8ef0f39b937 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:06.787516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:06.788155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.788433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.788702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] PATH_INFO: `/v3/users/72c9a29f748b4e5db5268c0c8a1e700b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.789848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c9a29f748b4e5db5268c0c8a1e700b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:06.791779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:06.867069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 909/1807] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:06 2022] POST /identity/v3/projects => generated 401 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:06.868506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:06.870282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:06.949673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fa5e4-7cc1-4c42-beac-b19f4f07cf8c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:06.954962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebab87-02e5-4006-92dc-a76cd49da050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:06.955567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebab87-02e5-4006-92dc-a76cd49da050 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:06.955879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebab87-02e5-4006-92dc-a76cd49da050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:06.956197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebab87-02e5-4006-92dc-a76cd49da050 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:06.956889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebab87-02e5-4006-92dc-a76cd49da050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:06.958839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebab87-02e5-4006-92dc-a76cd49da050 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:07.030264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c9a29f748b4e5db5268c0c8a1e700b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:07.054394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 910/1808] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:06 2022] POST /identity/v3/users => generated 307 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:07.059935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebab87-02e5-4006-92dc-a76cd49da050 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:07.076958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebab87-02e5-4006-92dc-a76cd49da050 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:07.089734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08dbdc-a3e1-48ac-baf2-217f5f118b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:07.089734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08dbdc-a3e1-48ac-baf2-217f5f118b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.089734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08dbdc-a3e1-48ac-baf2-217f5f118b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.089734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08dbdc-a3e1-48ac-baf2-217f5f118b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.090407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08dbdc-a3e1-48ac-baf2-217f5f118b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:07.092174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08dbdc-a3e1-48ac-baf2-217f5f118b86 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:07.105531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:07.106700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c9a29f748b4e5db5268c0c8a1e700b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:07.112544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 911/1809] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:07.117746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c9a29f748b4e5db5268c0c8a1e700b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:07.117887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08dbdc-a3e1-48ac-baf2-217f5f118b86 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:07.140798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08dbdc-a3e1-48ac-baf2-217f5f118b86 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:07.149220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:07.149898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.150180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.150458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] PATH_INFO: `/v3/projects/299c44ec8d304bb1a4862f0fd841173f/users/d719ecc0102d4b4199b49b3002a4988d/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.152003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c9a29f748b4e5db5268c0c8a1e700b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:07.153210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-72a770e1-56a4-4f9f-8eef-03fdff79ddfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c9a29f748b4e5db5268c0c8a1e700b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:07.163148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 899/1810] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:06 2022] DELETE /identity/v3/users/72c9a29f748b4e5db5268c0c8a1e700b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:07.169555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4a3a5-28c6-4cac-b166-9bf8a0b96144 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.169835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4a3a5-28c6-4cac-b166-9bf8a0b96144 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.171140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4a3a5-28c6-4cac-b166-9bf8a0b96144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.174374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] RBAC: Authorizing `identity:create_grant(project_id=299c44ec8d304bb1a4862f0fd841173f, user_id=d719ecc0102d4b4199b49b3002a4988d, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:07.179174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:07.197934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5dc4a3a5-28c6-4cac-b166-9bf8a0b96144 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:07.199253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5dc4a3a5-28c6-4cac-b166-9bf8a0b96144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:07.277292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 900/1811] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:07.296472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 912/1812] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:07 2022] PUT /identity/v3/projects/299c44ec8d304bb1a4862f0fd841173f/users/d719ecc0102d4b4199b49b3002a4988d/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:07.297704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4a3a5-28c6-4cac-b166-9bf8a0b96144 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:07.300790 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5dc4a3a5-28c6-4cac-b166-9bf8a0b96144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:07.315445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:07.317056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:07.324196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4a3a5-28c6-4cac-b166-9bf8a0b96144 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:07.407228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab79bd-62dc-459f-8372-242fa5b4f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:07.411552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab79bd-62dc-459f-8372-242fa5b4f271 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.411552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab79bd-62dc-459f-8372-242fa5b4f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.411552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab79bd-62dc-459f-8372-242fa5b4f271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.411552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab79bd-62dc-459f-8372-242fa5b4f271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:07.412493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6362-57ea-4bdb-8bc7-f9676e4b343b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:07.414422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab79bd-62dc-459f-8372-242fa5b4f271 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:07.416988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d89e8-a6f2-478f-ad62-5aad87c0508b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:07.417609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d89e8-a6f2-478f-ad62-5aad87c0508b service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.417884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d89e8-a6f2-478f-ad62-5aad87c0508b service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.418150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d89e8-a6f2-478f-ad62-5aad87c0508b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.431508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 901/1813] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:07.433319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab79bd-62dc-459f-8372-242fa5b4f271 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:07.451178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d89e8-a6f2-478f-ad62-5aad87c0508b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:07.451781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab79bd-62dc-459f-8372-242fa5b4f271 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:07.454573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d89e8-a6f2-478f-ad62-5aad87c0508b service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:07.463919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:07.465036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.465380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.465775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] PATH_INFO: `/v3/projects/299c44ec8d304bb1a4862f0fd841173f/users/d719ecc0102d4b4199b49b3002a4988d/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.469346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299c44ec8d304bb1a4862f0fd841173f, user_id=d719ecc0102d4b4199b49b3002a4988d, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:07.473292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:07.479481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 913/1814] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:07.504029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 902/1815] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:07 2022] PUT /identity/v3/projects/299c44ec8d304bb1a4862f0fd841173f/users/d719ecc0102d4b4199b49b3002a4988d/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:07.507402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60a6ac-1855-4b18-b7d1-b21c548b4bad None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.507688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60a6ac-1855-4b18-b7d1-b21c548b4bad None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.507965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60a6ac-1855-4b18-b7d1-b21c548b4bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.545169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bf60a6ac-1855-4b18-b7d1-b21c548b4bad None None] MFA Rules not processed for user `d719ecc0102d4b4199b49b3002a4988d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:07.546927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bf60a6ac-1855-4b18-b7d1-b21c548b4bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:07.548630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:07.629255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 914/1816] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:07.641091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:07.643020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:07.656568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60a6ac-1855-4b18-b7d1-b21c548b4bad None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:07.660040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bf60a6ac-1855-4b18-b7d1-b21c548b4bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:07.724001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc47a4-db23-427b-ba64-1600be747597 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:07.727985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2e0e-dbc0-4073-aeeb-9c8d912f2ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:07.728598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2e0e-dbc0-4073-aeeb-9c8d912f2ddb service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.736067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2e0e-dbc0-4073-aeeb-9c8d912f2ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.736067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2e0e-dbc0-4073-aeeb-9c8d912f2ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.739934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2e0e-dbc0-4073-aeeb-9c8d912f2ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:07.741351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2e0e-dbc0-4073-aeeb-9c8d912f2ddb service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:07.755276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 903/1817] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:07 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:07.773622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60a6ac-1855-4b18-b7d1-b21c548b4bad None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:07.779569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:07.780566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:07.780924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:07.781292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] PATH_INFO: `/v3/projects/16ce6afa133b4f5f8e1fcda32f84344c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:07.782833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ce6afa133b4f5f8e1fcda32f84344c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:07.786298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:07.903598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ce6afa133b4f5f8e1fcda32f84344c', 'request_id': 'req-c2500cb6-ab38-4155-8300-e981a76a6292'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:07.914020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ce6afa133b4f5f8e1fcda32f84344c', 'request_id': 'req-c2500cb6-ab38-4155-8300-e981a76a6292'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:07.921235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ce6afa133b4f5f8e1fcda32f84344c', 'request_id': 'req-c2500cb6-ab38-4155-8300-e981a76a6292'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:07.972434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2e0e-dbc0-4073-aeeb-9c8d912f2ddb service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:07.982835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2e0e-dbc0-4073-aeeb-9c8d912f2ddb service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:08.040958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:08.041568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.041871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.042142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.043933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.103223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:08.105008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:08.113025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] The token cache is being invalidate because project 16ce6afa133b4f5f8e1fcda32f84344c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:08.120518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.120518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c2500cb6-ab38-4155-8300-e981a76a6292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.120740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 904/1818] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:07 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:08.120843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 915/1819] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:07 2022] DELETE /identity/v3/projects/16ce6afa133b4f5f8e1fcda32f84344c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:08.120948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:08.121663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.121938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68fde-d2b9-44e6-a35a-02eb45cbc54d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.122293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68fde-d2b9-44e6-a35a-02eb45cbc54d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.122665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68fde-d2b9-44e6-a35a-02eb45cbc54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.147330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-c4a68fde-d2b9-44e6-a35a-02eb45cbc54d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:08.148708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c4a68fde-d2b9-44e6-a35a-02eb45cbc54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.234910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aed501-486f-4297-a715-41fed82bde56 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:08.242938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:08.245150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.245150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.245150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] PATH_INFO: `/v3/users/8ed5224823ad4e52b8ac1672d72d4bc9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.246362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed5224823ad4e52b8ac1672d72d4bc9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:08.265808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:08.272360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 916/1820] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:08.273263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a68fde-d2b9-44e6-a35a-02eb45cbc54d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:08.281338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c4a68fde-d2b9-44e6-a35a-02eb45cbc54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.293949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a68fde-d2b9-44e6-a35a-02eb45cbc54d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:08.299079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:08.300242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.300522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.300783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] PATH_INFO: `/v3/projects/47b6285add714b40b33c2f9223d92752` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.301918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b6285add714b40b33c2f9223d92752)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:08.303919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:08.544489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed5224823ad4e52b8ac1672d72d4bc9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.566145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b6285add714b40b33c2f9223d92752', 'request_id': 'req-13b66d12-071b-4d85-9679-89f035504e1f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.573605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b6285add714b40b33c2f9223d92752', 'request_id': 'req-13b66d12-071b-4d85-9679-89f035504e1f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.585083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b6285add714b40b33c2f9223d92752', 'request_id': 'req-13b66d12-071b-4d85-9679-89f035504e1f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.615392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed5224823ad4e52b8ac1672d72d4bc9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.627037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed5224823ad4e52b8ac1672d72d4bc9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.649110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed5224823ad4e52b8ac1672d72d4bc9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.649850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb6b50c8-9129-4edf-b91a-7a032f39368d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed5224823ad4e52b8ac1672d72d4bc9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.658533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 905/1821] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:08 2022] DELETE /identity/v3/users/8ed5224823ad4e52b8ac1672d72d4bc9 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:08.661626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e280e9-e2f5-4120-a040-1dd3b87d3a68 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.661626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e280e9-e2f5-4120-a040-1dd3b87d3a68 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.661626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e280e9-e2f5-4120-a040-1dd3b87d3a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.683791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b9e280e9-e2f5-4120-a040-1dd3b87d3a68 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:08.687417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b9e280e9-e2f5-4120-a040-1dd3b87d3a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.751500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] The token cache is being invalidate because project 47b6285add714b40b33c2f9223d92752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:08.753117 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.756388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:08.771021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 906/1822] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:08.771021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d3473-0840-46de-b027-f3ad73c2186d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.771675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 917/1823] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:08 2022] DELETE /identity/v3/projects/47b6285add714b40b33c2f9223d92752 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:08.771778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d3473-0840-46de-b027-f3ad73c2186d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.771778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d3473-0840-46de-b027-f3ad73c2186d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.771949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:08.774674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.814151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-eb7d3473-0840-46de-b027-f3ad73c2186d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:08.815758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb7d3473-0840-46de-b027-f3ad73c2186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.830772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 907/1824] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:08.830772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d3473-0840-46de-b027-f3ad73c2186d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:08.830772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb7d3473-0840-46de-b027-f3ad73c2186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.854250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d3473-0840-46de-b027-f3ad73c2186d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:08.867787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:08.868026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b66d12-071b-4d85-9679-89f035504e1f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:08.868448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.868847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.869229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.870056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:08.870243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:08.871980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:08.872832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:08.873474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.876740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.876740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] PATH_INFO: `/v3/users/4d9ccddcf9d54fe48c4363351a9e97dc` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.876740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9ccddcf9d54fe48c4363351a9e97dc)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:08.877270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:08.887132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 908/1825] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:08.887132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:08.891569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:08.942248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:08.956218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe809cdc-bab0-49c3-9bce-6f8017756ac4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:08.960131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd081-3b77-40fc-ab1d-9d0486e5e7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:08.960749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd081-3b77-40fc-ab1d-9d0486e5e7cd service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:08.961030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd081-3b77-40fc-ab1d-9d0486e5e7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:08.961301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd081-3b77-40fc-ab1d-9d0486e5e7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:08.971797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fd081-3b77-40fc-ab1d-9d0486e5e7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:08.973383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fd081-3b77-40fc-ab1d-9d0486e5e7cd service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:08.983344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 909/1826] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:08.984433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd081-3b77-40fc-ab1d-9d0486e5e7cd service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:08.994378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd081-3b77-40fc-ab1d-9d0486e5e7cd service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:08.999524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cce3e8-79af-460d-aae0-6a9328b939bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:09.000137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce3e8-79af-460d-aae0-6a9328b939bc admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.000399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce3e8-79af-460d-aae0-6a9328b939bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:09.000671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce3e8-79af-460d-aae0-6a9328b939bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:09.001297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cce3e8-79af-460d-aae0-6a9328b939bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:09.007553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cce3e8-79af-460d-aae0-6a9328b939bc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:09.194443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 910/1827] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:08 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:09.199667 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cce3e8-79af-460d-aae0-6a9328b939bc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:09.204197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9ccddcf9d54fe48c4363351a9e97dc'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.212427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9ccddcf9d54fe48c4363351a9e97dc'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.267927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cce3e8-79af-460d-aae0-6a9328b939bc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:09.274601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c07c16-ba5f-490e-af69-f25806bee251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:09.275129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c07c16-ba5f-490e-af69-f25806bee251 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.275406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c07c16-ba5f-490e-af69-f25806bee251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:09.275674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c07c16-ba5f-490e-af69-f25806bee251 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:09.276297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c07c16-ba5f-490e-af69-f25806bee251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:09.278196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c07c16-ba5f-490e-af69-f25806bee251 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:09.301023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9ccddcf9d54fe48c4363351a9e97dc'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.301678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9ccddcf9d54fe48c4363351a9e97dc'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.318616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9ccddcf9d54fe48c4363351a9e97dc'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.337964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 918/1828] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:08 2022] DELETE /identity/v3/users/4d9ccddcf9d54fe48c4363351a9e97dc => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:09.376231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 911/1829] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:09 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:09.380727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:09.382181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:09.453520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a745247-848f-4b7d-98a2-979c04a1c6ea admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:09.459099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:09.460877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.461166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:09.461442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:09.462101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:09.463773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:09.474226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 919/1830] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:09.478001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c07c16-ba5f-490e-af69-f25806bee251 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:09.488021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c07c16-ba5f-490e-af69-f25806bee251 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:09.492917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a217c-3b99-4903-823e-0cb172eb061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:09.494696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a217c-3b99-4903-823e-0cb172eb061e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.494978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a217c-3b99-4903-823e-0cb172eb061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:09.495249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a217c-3b99-4903-823e-0cb172eb061e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:09.495907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a217c-3b99-4903-823e-0cb172eb061e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:09.509451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a217c-3b99-4903-823e-0cb172eb061e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:09.510710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 912/1831] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:09.510986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:09.513601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:09.513725 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a217c-3b99-4903-823e-0cb172eb061e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:09.524508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a217c-3b99-4903-823e-0cb172eb061e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:09.530979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e374-c025-4bf4-b64c-b9d1d0d8c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:09.530979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e374-c025-4bf4-b64c-b9d1d0d8c11c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.530979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e374-c025-4bf4-b64c-b9d1d0d8c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:09.530979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e374-c025-4bf4-b64c-b9d1d0d8c11c admin admin] PATH_INFO: `/v3/projects/203701944a054af387bd0a761279dcd7/users/17aabc97edbd44f08ca2ea0c623b368e/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:09.538911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cddd-149b-42b2-9cc2-42cef5eadec4 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:09.544927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:09.545642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.545791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:09.546196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] PATH_INFO: `/v3/projects/7245bce03b794343952052f6f36db9f5` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:09.547389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7245bce03b794343952052f6f36db9f5)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:09.548037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e374-c025-4bf4-b64c-b9d1d0d8c11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=203701944a054af387bd0a761279dcd7, user_id=17aabc97edbd44f08ca2ea0c623b368e, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:09.549289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:09.551051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e374-c025-4bf4-b64c-b9d1d0d8c11c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:09.677823 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 913/1832] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:09 2022] PUT /identity/v3/projects/203701944a054af387bd0a761279dcd7/users/17aabc97edbd44f08ca2ea0c623b368e/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:09.687969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7245bce03b794343952052f6f36db9f5', 'request_id': 'req-7b136724-8a64-4624-8e7a-45f653e995f1'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.689159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148bf7-3585-4303-9bb9-6641a7466676 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.689441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148bf7-3585-4303-9bb9-6641a7466676 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:09.689712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148bf7-3585-4303-9bb9-6641a7466676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:09.695564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7245bce03b794343952052f6f36db9f5', 'request_id': 'req-7b136724-8a64-4624-8e7a-45f653e995f1'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.704160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7245bce03b794343952052f6f36db9f5', 'request_id': 'req-7b136724-8a64-4624-8e7a-45f653e995f1'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.722237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1b148bf7-3585-4303-9bb9-6641a7466676 None None] MFA Rules not processed for user `17aabc97edbd44f08ca2ea0c623b368e`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:09.723653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1b148bf7-3585-4303-9bb9-6641a7466676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:09.811724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 914/1833] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:09.813718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148bf7-3585-4303-9bb9-6641a7466676 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:09.838811 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] The token cache is being invalidate because project 7245bce03b794343952052f6f36db9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:09.839407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.840017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:09.842450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 920/1834] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:09 2022] DELETE /identity/v3/projects/7245bce03b794343952052f6f36db9f5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:09.846982 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:09.848872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:09.941615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148bf7-3585-4303-9bb9-6641a7466676 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:09.947002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:09.947624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.947904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:09.948175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:09.948835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:09.951273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:09.959314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b136724-8a64-4624-8e7a-45f653e995f1 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:09.992990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:09.993690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:09.998663 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.000709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] PATH_INFO: `/v3/users/ed71d201cd294476b52e69aff12dba42` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.014830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed71d201cd294476b52e69aff12dba42)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.017961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.112312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 915/1835] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:09 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:10.116845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:10.119346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:10.234558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d360b6-03af-49d6-9765-4d2863708029 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:10.239658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:10.240670 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.240952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.241220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.241846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.243934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.272358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed71d201cd294476b52e69aff12dba42'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.290354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed71d201cd294476b52e69aff12dba42'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.336466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 916/1836] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:10 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:10.337107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:10.338734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:10.346925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed71d201cd294476b52e69aff12dba42'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.348313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed71d201cd294476b52e69aff12dba42'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.351467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145013d7-1ddc-4062-880f-b9cc3d7eb9a6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:10.369934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:10.371324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.371722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.371966 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] PATH_INFO: `/v3/projects/dd981ca937c540ca9a94750702c5d193` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.373255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd981ca937c540ca9a94750702c5d193)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.375774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.383922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed71d201cd294476b52e69aff12dba42'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.392932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 921/1837] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:09 2022] DELETE /identity/v3/users/ed71d201cd294476b52e69aff12dba42 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:10.405825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:10.407601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:10.481626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cb2b4-72b7-4071-8e58-63e6ba032043 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:10.487818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e38c-ddb7-4f13-b1b3-7f397ea42746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:10.488657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e38c-ddb7-4f13-b1b3-7f397ea42746 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.489148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e38c-ddb7-4f13-b1b3-7f397ea42746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.489613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e38c-ddb7-4f13-b1b3-7f397ea42746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.490439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4e38c-ddb7-4f13-b1b3-7f397ea42746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.492223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4e38c-ddb7-4f13-b1b3-7f397ea42746 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.520959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 922/1838] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:10.524830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e38c-ddb7-4f13-b1b3-7f397ea42746 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:10.531633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd981ca937c540ca9a94750702c5d193', 'request_id': 'req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.537020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e38c-ddb7-4f13-b1b3-7f397ea42746 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:10.600878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:10.601939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.602336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.602667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] PATH_INFO: `/v3/projects/3ce821f41d9a40119a8bba040d1d2a2c/users/e405f1a1928b43878594fa5a7e17dc8b/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.615144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:10.617519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd981ca937c540ca9a94750702c5d193', 'request_id': 'req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.622276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce821f41d9a40119a8bba040d1d2a2c, user_id=e405f1a1928b43878594fa5a7e17dc8b, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.625081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.626424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd981ca937c540ca9a94750702c5d193', 'request_id': 'req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.639923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] The token cache is being invalidate because project dd981ca937c540ca9a94750702c5d193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:10.640210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.640884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5377ea8-9e3e-4dd5-b4a2-41aebb4975d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:10.642499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 917/1839] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:10 2022] DELETE /identity/v3/projects/dd981ca937c540ca9a94750702c5d193 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:10.648004 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd984-061d-49fb-b655-944cd2c3fcbb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.649072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd984-061d-49fb-b655-944cd2c3fcbb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.649072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd984-061d-49fb-b655-944cd2c3fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.669849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-56ecd984-061d-49fb-b655-944cd2c3fcbb None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:10.671585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-56ecd984-061d-49fb-b655-944cd2c3fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:10.687759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 918/1840] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:10.696240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73538-2d33-4a43-9fc7-52130bb0d776 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.696597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73538-2d33-4a43-9fc7-52130bb0d776 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.697551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73538-2d33-4a43-9fc7-52130bb0d776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.721361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7de73538-2d33-4a43-9fc7-52130bb0d776 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:10.722639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7de73538-2d33-4a43-9fc7-52130bb0d776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:10.731914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 919/1841] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:10.735921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de73538-2d33-4a43-9fc7-52130bb0d776 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:10.748534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de73538-2d33-4a43-9fc7-52130bb0d776 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:10.765989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:10.765989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.765989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.765989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.766299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:10.766299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.766299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.777001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 920/1842] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:42:10.778148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:10.790385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f8a5-0354-4cda-aeb6-979f0d0065df admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:10.793225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 923/1843] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:10 2022] PUT /identity/v3/projects/3ce821f41d9a40119a8bba040d1d2a2c/users/e405f1a1928b43878594fa5a7e17dc8b/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:10.797009 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:10.798666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:10.854153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffaf9f9-70a2-47f1-84df-1da4240b871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:10.855467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf9f9-70a2-47f1-84df-1da4240b871a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.855751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf9f9-70a2-47f1-84df-1da4240b871a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.856024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffaf9f9-70a2-47f1-84df-1da4240b871a admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.856690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffaf9f9-70a2-47f1-84df-1da4240b871a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.858682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffaf9f9-70a2-47f1-84df-1da4240b871a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.889268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087dfc6-e546-4776-bf71-130756192ce3 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:10.895841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51f2eb-3ee5-4bd2-934d-61d49394cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:10.896515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51f2eb-3ee5-4bd2-934d-61d49394cd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.896801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51f2eb-3ee5-4bd2-934d-61d49394cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.897073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51f2eb-3ee5-4bd2-934d-61d49394cd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.897771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51f2eb-3ee5-4bd2-934d-61d49394cd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.900175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51f2eb-3ee5-4bd2-934d-61d49394cd49 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.917480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 924/1844] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:10.918695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51f2eb-3ee5-4bd2-934d-61d49394cd49 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:10.938284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51f2eb-3ee5-4bd2-934d-61d49394cd49 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:10.943730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f00d6-b98c-416b-927a-e1b7a072c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:10.944555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f00d6-b98c-416b-927a-e1b7a072c3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.945110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f00d6-b98c-416b-927a-e1b7a072c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.945488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f00d6-b98c-416b-927a-e1b7a072c3a3 admin admin] PATH_INFO: `/v3/projects/3ce821f41d9a40119a8bba040d1d2a2c/users/e405f1a1928b43878594fa5a7e17dc8b/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.947705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f00d6-b98c-416b-927a-e1b7a072c3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce821f41d9a40119a8bba040d1d2a2c, user_id=e405f1a1928b43878594fa5a7e17dc8b, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:10.950512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f00d6-b98c-416b-927a-e1b7a072c3a3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:10.973524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 925/1845] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:10 2022] PUT /identity/v3/projects/3ce821f41d9a40119a8bba040d1d2a2c/users/e405f1a1928b43878594fa5a7e17dc8b/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:10.975360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43142-8537-4a36-b655-f5312a65830d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:10.975751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43142-8537-4a36-b655-f5312a65830d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:10.976126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43142-8537-4a36-b655-f5312a65830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:10.990127 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 921/1846] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:10 2022] POST /identity/v3/projects => generated 393 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:10.992331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffaf9f9-70a2-47f1-84df-1da4240b871a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:11.035949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7cf43142-8537-4a36-b655-f5312a65830d None None] MFA Rules not processed for user `e405f1a1928b43878594fa5a7e17dc8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:11.037261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7cf43142-8537-4a36-b655-f5312a65830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:11.113469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffaf9f9-70a2-47f1-84df-1da4240b871a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:11.118436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff673-a687-4fd1-a8e4-88beec9a5351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:11.119096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff673-a687-4fd1-a8e4-88beec9a5351 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.119399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff673-a687-4fd1-a8e4-88beec9a5351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.119641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff673-a687-4fd1-a8e4-88beec9a5351 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.120270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afff673-a687-4fd1-a8e4-88beec9a5351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:11.122438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afff673-a687-4fd1-a8e4-88beec9a5351 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:11.148427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 926/1847] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:11.161230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf43142-8537-4a36-b655-f5312a65830d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:11.162856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7cf43142-8537-4a36-b655-f5312a65830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:11.248332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf43142-8537-4a36-b655-f5312a65830d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:11.252846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 922/1848] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:10 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:11.256332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:11.256332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.256332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.256332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.258271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:11.259650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff673-a687-4fd1-a8e4-88beec9a5351 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:11.280376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff673-a687-4fd1-a8e4-88beec9a5351 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:11.298084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cccc3b-f088-44a7-8254-4fd4378d1816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:11.299178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cccc3b-f088-44a7-8254-4fd4378d1816 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.300020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cccc3b-f088-44a7-8254-4fd4378d1816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.300301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cccc3b-f088-44a7-8254-4fd4378d1816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.301476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cccc3b-f088-44a7-8254-4fd4378d1816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:11.306081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cccc3b-f088-44a7-8254-4fd4378d1816 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:11.337387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 923/1849] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:11.339473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cccc3b-f088-44a7-8254-4fd4378d1816 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:11.364449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cccc3b-f088-44a7-8254-4fd4378d1816 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:11.371191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:11.380153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4834618-739e-49c9-a5f7-35310edbb170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:11.380323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:11.380779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834618-739e-49c9-a5f7-35310edbb170 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.381057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834618-739e-49c9-a5f7-35310edbb170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.381711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834618-739e-49c9-a5f7-35310edbb170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.381977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4834618-739e-49c9-a5f7-35310edbb170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:11.383713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4834618-739e-49c9-a5f7-35310edbb170 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:11.413401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 924/1850] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:11.416707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 927/1851] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:11.418756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4834618-739e-49c9-a5f7-35310edbb170 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:11.434254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4834618-739e-49c9-a5f7-35310edbb170 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:11.458000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c3fe9-74a0-4d4b-99be-847b48d77c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:11.458709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3fe9-74a0-4d4b-99be-847b48d77c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.458990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3fe9-74a0-4d4b-99be-847b48d77c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.459531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3fe9-74a0-4d4b-99be-847b48d77c9f admin admin] PATH_INFO: `/v3/projects/6873025964e34776bf949db2a5a368b4/users/bf8467a1494440bdb91f81c7265d13e0/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.495929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c3fe9-74a0-4d4b-99be-847b48d77c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6873025964e34776bf949db2a5a368b4, user_id=bf8467a1494440bdb91f81c7265d13e0, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:11.500979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c3fe9-74a0-4d4b-99be-847b48d77c9f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:11.519479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:11.523010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:11.562691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9bef-ee05-4dad-a7db-fb95f9c44ff6 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:11.569141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:11.569725 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.570101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.570500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] PATH_INFO: `/v3/projects/9ed3b9baf2104e0dbb07bf1b41603a15` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.573084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed3b9baf2104e0dbb07bf1b41603a15)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:11.575572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:11.604786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 925/1852] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:11 2022] PUT /identity/v3/projects/6873025964e34776bf949db2a5a368b4/users/bf8467a1494440bdb91f81c7265d13e0/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:11.618348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c321e-6e18-4ca0-98cf-1b2108146664 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.618659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c321e-6e18-4ca0-98cf-1b2108146664 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.618934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c321e-6e18-4ca0-98cf-1b2108146664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.677066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e91c321e-6e18-4ca0-98cf-1b2108146664 None None] MFA Rules not processed for user `bf8467a1494440bdb91f81c7265d13e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:11.678300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e91c321e-6e18-4ca0-98cf-1b2108146664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:11.742975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed3b9baf2104e0dbb07bf1b41603a15', 'request_id': 'req-13124fdd-e3c6-4472-bade-cfd5c038bb73'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:11.753384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed3b9baf2104e0dbb07bf1b41603a15', 'request_id': 'req-13124fdd-e3c6-4472-bade-cfd5c038bb73'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:11.758188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed3b9baf2104e0dbb07bf1b41603a15', 'request_id': 'req-13124fdd-e3c6-4472-bade-cfd5c038bb73'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:11.805652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 926/1853] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:11.813573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c321e-6e18-4ca0-98cf-1b2108146664 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:11.878518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] The token cache is being invalidate because project 9ed3b9baf2104e0dbb07bf1b41603a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:11.878812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:11.879620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-13124fdd-e3c6-4472-bade-cfd5c038bb73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:11.880499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c321e-6e18-4ca0-98cf-1b2108146664 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:11.881479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 928/1854] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:11 2022] DELETE /identity/v3/projects/9ed3b9baf2104e0dbb07bf1b41603a15 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:11.887010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07288ded-7765-4dcc-bf65-01627175f9ec None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.887774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07288ded-7765-4dcc-bf65-01627175f9ec None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.888319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07288ded-7765-4dcc-bf65-01627175f9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.915730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-07288ded-7765-4dcc-bf65-01627175f9ec None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:11.917661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-07288ded-7765-4dcc-bf65-01627175f9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:11.987882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:11.988847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:11.989229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:11.989743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:11.990859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:11.995040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.025767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 929/1855] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:12.033414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad343e-8829-41d3-8dba-df1a75676d50 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.033754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad343e-8829-41d3-8dba-df1a75676d50 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.034027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad343e-8829-41d3-8dba-df1a75676d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.055248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-5dad343e-8829-41d3-8dba-df1a75676d50 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:12.056459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5dad343e-8829-41d3-8dba-df1a75676d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:12.065501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 930/1856] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:12.069573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad343e-8829-41d3-8dba-df1a75676d50 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.079590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad343e-8829-41d3-8dba-df1a75676d50 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.087226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.087715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.087990 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.088255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.088896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:12.089196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.090950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.099515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 927/1857] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:11 2022] POST /identity/v3/projects => generated 391 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:12.103218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.106382 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:12.110339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:12.115292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 931/1858] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:42:12.119919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.130135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcdca6-78f3-440d-9a31-2a38790f46c8 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.177763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35556d15-e8cd-47b5-b115-430be221da3c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.182552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39099f06-3a88-47e3-8a0f-d880a01f799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.183161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39099f06-3a88-47e3-8a0f-d880a01f799e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.183643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39099f06-3a88-47e3-8a0f-d880a01f799e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.183746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39099f06-3a88-47e3-8a0f-d880a01f799e admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.184484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39099f06-3a88-47e3-8a0f-d880a01f799e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.186410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39099f06-3a88-47e3-8a0f-d880a01f799e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.190625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f7ed-ed27-40e8-a84a-484c1c8a5441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.191459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f7ed-ed27-40e8-a84a-484c1c8a5441 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.191877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f7ed-ed27-40e8-a84a-484c1c8a5441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.192288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f7ed-ed27-40e8-a84a-484c1c8a5441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.193051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668f7ed-ed27-40e8-a84a-484c1c8a5441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.195486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668f7ed-ed27-40e8-a84a-484c1c8a5441 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.280343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 928/1859] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:12 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:12.284753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39099f06-3a88-47e3-8a0f-d880a01f799e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.296095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39099f06-3a88-47e3-8a0f-d880a01f799e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.300428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9624336-c027-4d54-8d0d-fc9e49ccb62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.301038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9624336-c027-4d54-8d0d-fc9e49ccb62f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.301313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9624336-c027-4d54-8d0d-fc9e49ccb62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.301710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9624336-c027-4d54-8d0d-fc9e49ccb62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.302370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9624336-c027-4d54-8d0d-fc9e49ccb62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.304188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9624336-c027-4d54-8d0d-fc9e49ccb62f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.320436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 929/1860] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:12.323261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9624336-c027-4d54-8d0d-fc9e49ccb62f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.340820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9624336-c027-4d54-8d0d-fc9e49ccb62f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.347846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff372a88-356a-470b-9116-e1df320a3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.352836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372a88-356a-470b-9116-e1df320a3c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.352836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372a88-356a-470b-9116-e1df320a3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.352836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372a88-356a-470b-9116-e1df320a3c83 admin admin] PATH_INFO: `/v3/projects/f2ad4d7a0261420aab4b9d3cc4a000c7/users/c4e591869c664ae19148dd42754af7e0/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.370868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff372a88-356a-470b-9116-e1df320a3c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ad4d7a0261420aab4b9d3cc4a000c7, user_id=c4e591869c664ae19148dd42754af7e0, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.373976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff372a88-356a-470b-9116-e1df320a3c83 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.439453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 932/1861] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:12 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:12.443734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f7ed-ed27-40e8-a84a-484c1c8a5441 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.485044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 930/1862] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:12 2022] PUT /identity/v3/projects/f2ad4d7a0261420aab4b9d3cc4a000c7/users/c4e591869c664ae19148dd42754af7e0/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:12.486636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff372a88-356a-470b-9116-e1df320a3c83 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.628935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff372a88-356a-470b-9116-e1df320a3c83 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.643889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86b16c-ea28-4b2b-b111-c9f49084df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.644835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b16c-ea28-4b2b-b111-c9f49084df51 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.645114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b16c-ea28-4b2b-b111-c9f49084df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.645386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b16c-ea28-4b2b-b111-c9f49084df51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.646040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86b16c-ea28-4b2b-b111-c9f49084df51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.647835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86b16c-ea28-4b2b-b111-c9f49084df51 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.649054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f7ed-ed27-40e8-a84a-484c1c8a5441 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.655023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc42b76-8fa8-41d9-8085-7302d6350fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.655743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42b76-8fa8-41d9-8085-7302d6350fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.658092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42b76-8fa8-41d9-8085-7302d6350fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.658092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42b76-8fa8-41d9-8085-7302d6350fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.658092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc42b76-8fa8-41d9-8085-7302d6350fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.660594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc42b76-8fa8-41d9-8085-7302d6350fc7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.661533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 931/1863] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:12.665998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86b16c-ea28-4b2b-b111-c9f49084df51 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.678767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86b16c-ea28-4b2b-b111-c9f49084df51 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.683876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc9d2-5bfd-4991-a0f2-70f24d58f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.684554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc9d2-5bfd-4991-a0f2-70f24d58f385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.684831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc9d2-5bfd-4991-a0f2-70f24d58f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.685105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc9d2-5bfd-4991-a0f2-70f24d58f385 admin admin] PATH_INFO: `/v3/projects/f2ad4d7a0261420aab4b9d3cc4a000c7/users/c4e591869c664ae19148dd42754af7e0/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.687277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc9d2-5bfd-4991-a0f2-70f24d58f385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ad4d7a0261420aab4b9d3cc4a000c7, user_id=c4e591869c664ae19148dd42754af7e0, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.689992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc9d2-5bfd-4991-a0f2-70f24d58f385 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.705375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 932/1864] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:12 2022] PUT /identity/v3/projects/f2ad4d7a0261420aab4b9d3cc4a000c7/users/c4e591869c664ae19148dd42754af7e0/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:12.716621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819c8e3-e993-4e4b-ae1b-f120abd1d1ce None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.717176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819c8e3-e993-4e4b-ae1b-f120abd1d1ce None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.717612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819c8e3-e993-4e4b-ae1b-f120abd1d1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.748340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6819c8e3-e993-4e4b-ae1b-f120abd1d1ce None None] MFA Rules not processed for user `c4e591869c664ae19148dd42754af7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:12.749907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6819c8e3-e993-4e4b-ae1b-f120abd1d1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:12.798529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 933/1865] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:12 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:12.803187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc42b76-8fa8-41d9-8085-7302d6350fc7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.815208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc42b76-8fa8-41d9-8085-7302d6350fc7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.831938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 933/1866] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:12.844167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819c8e3-e993-4e4b-ae1b-f120abd1d1ce None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.845840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6819c8e3-e993-4e4b-ae1b-f120abd1d1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:12.875693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed242d-dde0-4b12-90f1-289ed6fe9f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.876539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed242d-dde0-4b12-90f1-289ed6fe9f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.876820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed242d-dde0-4b12-90f1-289ed6fe9f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.877428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed242d-dde0-4b12-90f1-289ed6fe9f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.877853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed242d-dde0-4b12-90f1-289ed6fe9f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.879375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed242d-dde0-4b12-90f1-289ed6fe9f59 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.890553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 934/1867] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:12.894817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed242d-dde0-4b12-90f1-289ed6fe9f59 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.905441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed242d-dde0-4b12-90f1-289ed6fe9f59 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.911099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3bed2-68ad-47ac-875e-0aec04b7ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.911722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3bed2-68ad-47ac-875e-0aec04b7ec2c admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.912003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3bed2-68ad-47ac-875e-0aec04b7ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.912272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3bed2-68ad-47ac-875e-0aec04b7ec2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.912906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3bed2-68ad-47ac-875e-0aec04b7ec2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.913476 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819c8e3-e993-4e4b-ae1b-f120abd1d1ce None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.914625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3bed2-68ad-47ac-875e-0aec04b7ec2c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.917100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.917701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.917978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.918243 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.926505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 935/1868] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:12.930030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3bed2-68ad-47ac-875e-0aec04b7ec2c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.933636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.935115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.943819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3bed2-68ad-47ac-875e-0aec04b7ec2c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:12.943987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a41835-427d-4987-97e9-fa1cf9a1bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:12.944890 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41835-427d-4987-97e9-fa1cf9a1bf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:12.945011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 934/1869] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:12.945102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41835-427d-4987-97e9-fa1cf9a1bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:12.945320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41835-427d-4987-97e9-fa1cf9a1bf78 admin admin] PATH_INFO: `/v3/projects/c2acaa47c7834b38bfa1c462da6862b1/users/6e4b9fe7494144529ea899a5910fe691/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:12.960568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a41835-427d-4987-97e9-fa1cf9a1bf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2acaa47c7834b38bfa1c462da6862b1, user_id=6e4b9fe7494144529ea899a5910fe691, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:12.963244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a41835-427d-4987-97e9-fa1cf9a1bf78 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:12.993263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:12.994707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:13.005824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e59c7-fb43-4d2b-8e5a-4316ad88b736 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:13.010183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:13.010816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:13.011091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:13.011355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:13.013305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:13.062148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 936/1870] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:12 2022] PUT /identity/v3/projects/c2acaa47c7834b38bfa1c462da6862b1/users/6e4b9fe7494144529ea899a5910fe691/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:13.075228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed563e09-7534-4de1-9cd5-6e39838f35af None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:13.075511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed563e09-7534-4de1-9cd5-6e39838f35af None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:13.075783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed563e09-7534-4de1-9cd5-6e39838f35af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:13.076518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:13.078186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:13.088338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 935/1871] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:13.115202 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ed563e09-7534-4de1-9cd5-6e39838f35af None None] MFA Rules not processed for user `6e4b9fe7494144529ea899a5910fe691`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:13.116453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ed563e09-7534-4de1-9cd5-6e39838f35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:13.188513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 937/1872] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:13.200507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:13.209838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a06fca-e809-451e-89a4-5c835f122cd3 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:13.258772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8d45-81bb-42d8-bd44-3cbed6dd3ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:13.259385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8d45-81bb-42d8-bd44-3cbed6dd3ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:13.259662 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8d45-81bb-42d8-bd44-3cbed6dd3ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:13.259931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8d45-81bb-42d8-bd44-3cbed6dd3ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:13.268467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a8d45-81bb-42d8-bd44-3cbed6dd3ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:13.269928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a8d45-81bb-42d8-bd44-3cbed6dd3ac8 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:13.278608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 936/1873] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:13.432594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:13.901356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:14.348508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed563e09-7534-4de1-9cd5-6e39838f35af None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:14.349986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ed563e09-7534-4de1-9cd5-6e39838f35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:14.430009 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed563e09-7534-4de1-9cd5-6e39838f35af None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:14.434953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:14.435620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:14.435900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:14.436171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] PATH_INFO: `/v3/users/6a95a7bb8fbf457da4e981a4e50627c3` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:14.437437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a95a7bb8fbf457da4e981a4e50627c3)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:14.439492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:14.621035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a95a7bb8fbf457da4e981a4e50627c3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:14.629933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a95a7bb8fbf457da4e981a4e50627c3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:14.701338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a95a7bb8fbf457da4e981a4e50627c3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:14.701954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a95a7bb8fbf457da4e981a4e50627c3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:14.716054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-97f6b36e-91fb-4ede-bf52-61adbf906c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a95a7bb8fbf457da4e981a4e50627c3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:14.726795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 938/1874] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:14 2022] DELETE /identity/v3/users/6a95a7bb8fbf457da4e981a4e50627c3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:14.728383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ed50f-07ff-42ac-8738-1dd58ad37680 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:14.728859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ed50f-07ff-42ac-8738-1dd58ad37680 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:14.729040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ed50f-07ff-42ac-8738-1dd58ad37680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:14.750189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f03ed50f-07ff-42ac-8738-1dd58ad37680 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:14.751525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f03ed50f-07ff-42ac-8738-1dd58ad37680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:14.764866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e7f4-51c4-4b79-850a-313b9d639077 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:14.765155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e7f4-51c4-4b79-850a-313b9d639077 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:14.765480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e7f4-51c4-4b79-850a-313b9d639077 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:14.773149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 939/1875] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:42:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:42:14.774302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce013-f909-434e-bb02-4bc2fe96357e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:14.774628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce013-f909-434e-bb02-4bc2fe96357e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:14.774906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce013-f909-434e-bb02-4bc2fe96357e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:14.801348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f53ce013-f909-434e-bb02-4bc2fe96357e None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:14.802799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f53ce013-f909-434e-bb02-4bc2fe96357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:14.830889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 937/1876] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:14.834238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ed50f-07ff-42ac-8738-1dd58ad37680 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:14.835705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f03ed50f-07ff-42ac-8738-1dd58ad37680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:14.909715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 940/1877] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:42:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:14.936104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ed50f-07ff-42ac-8738-1dd58ad37680 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:14.940625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:14.941240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:14.941565 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:14.941840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:14.952810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:14.958506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:14.968069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 938/1878] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:15.088353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ce013-f909-434e-bb02-4bc2fe96357e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:15.090511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f53ce013-f909-434e-bb02-4bc2fe96357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:15.106761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ce013-f909-434e-bb02-4bc2fe96357e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:15.114102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7798f3-e92a-4fcf-acaa-aabb10661281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:15.114952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7798f3-e92a-4fcf-acaa-aabb10661281 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:15.115067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7798f3-e92a-4fcf-acaa-aabb10661281 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:15.115296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7798f3-e92a-4fcf-acaa-aabb10661281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:15.132685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7798f3-e92a-4fcf-acaa-aabb10661281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:15.134398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7798f3-e92a-4fcf-acaa-aabb10661281 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:15.149664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 941/1879] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:15.415494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:15.621872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:15.623762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:15.636868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc4a6e-dc3a-4db9-b436-bbaeb00bcc1b service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:15.641497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:15.642154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:15.642393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:15.646656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] PATH_INFO: `/v3/projects/1d6565d6658640f7b4c0d434c6e0ae9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:15.646656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6565d6658640f7b4c0d434c6e0ae9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:15.646656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:15.832516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6565d6658640f7b4c0d434c6e0ae9e', 'request_id': 'req-37ed1692-9bab-46d1-ab10-4adbb88c42f6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:15.855094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:15.911842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6565d6658640f7b4c0d434c6e0ae9e', 'request_id': 'req-37ed1692-9bab-46d1-ab10-4adbb88c42f6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:15.918437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6565d6658640f7b4c0d434c6e0ae9e', 'request_id': 'req-37ed1692-9bab-46d1-ab10-4adbb88c42f6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:15.929748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] The token cache is being invalidate because project 1d6565d6658640f7b4c0d434c6e0ae9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:15.930036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:15.930722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:15.932218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 939/1880] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:15 2022] DELETE /identity/v3/projects/1d6565d6658640f7b4c0d434c6e0ae9e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:15.936263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7798f3-e92a-4fcf-acaa-aabb10661281 service nova] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:15.948173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7798f3-e92a-4fcf-acaa-aabb10661281 service nova] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:16.004350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:16.004973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:16.005247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:16.005512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] PATH_INFO: `/v3/users/d719ecc0102d4b4199b49b3002a4988d` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:16.006658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d719ecc0102d4b4199b49b3002a4988d)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:16.008560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:16.219275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd719ecc0102d4b4199b49b3002a4988d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:16.227790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd719ecc0102d4b4199b49b3002a4988d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:16.289714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd719ecc0102d4b4199b49b3002a4988d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:16.290694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd719ecc0102d4b4199b49b3002a4988d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:16.304044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fc62d4ad-d9a0-487d-ae16-00bfb361b300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd719ecc0102d4b4199b49b3002a4988d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:16.312145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 942/1881] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:15 2022] DELETE /identity/v3/users/d719ecc0102d4b4199b49b3002a4988d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:16.696230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:16.927627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:16.965795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:16.967766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:16.991826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed1692-9bab-46d1-ab10-4adbb88c42f6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:17.054092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:17.054843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.055118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.055546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] PATH_INFO: `/v3/projects/299c44ec8d304bb1a4862f0fd841173f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.056843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=299c44ec8d304bb1a4862f0fd841173f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:17.058806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:17.184759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299c44ec8d304bb1a4862f0fd841173f', 'request_id': 'req-3fad347c-fb07-4712-b3dd-cfd049f253ce'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:17.226256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299c44ec8d304bb1a4862f0fd841173f', 'request_id': 'req-3fad347c-fb07-4712-b3dd-cfd049f253ce'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:17.232941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299c44ec8d304bb1a4862f0fd841173f', 'request_id': 'req-3fad347c-fb07-4712-b3dd-cfd049f253ce'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:17.243873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] The token cache is being invalidate because project 299c44ec8d304bb1a4862f0fd841173f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:17.244162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:17.244820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3fad347c-fb07-4712-b3dd-cfd049f253ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:17.246453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 940/1882] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:16 2022] DELETE /identity/v3/projects/299c44ec8d304bb1a4862f0fd841173f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:17.251456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba859999-7f16-41a7-a8b1-0f9343571720 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.251946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba859999-7f16-41a7-a8b1-0f9343571720 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.252650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba859999-7f16-41a7-a8b1-0f9343571720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.272783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ba859999-7f16-41a7-a8b1-0f9343571720 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:17.273996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ba859999-7f16-41a7-a8b1-0f9343571720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:17.334162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 943/1883] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:17.342565 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacfaf9-7803-4c04-aabc-c12d470db7e7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.342915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacfaf9-7803-4c04-aabc-c12d470db7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.343278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacfaf9-7803-4c04-aabc-c12d470db7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.363194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4dacfaf9-7803-4c04-aabc-c12d470db7e7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:17.364403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4dacfaf9-7803-4c04-aabc-c12d470db7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:17.372458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 941/1884] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:17.376761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba859999-7f16-41a7-a8b1-0f9343571720 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:17.387251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba859999-7f16-41a7-a8b1-0f9343571720 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:17.392842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:17.393439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.393718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.393989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.394673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:17.394975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:17.396633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:17.408312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 944/1885] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:17.414911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacfaf9-7803-4c04-aabc-c12d470db7e7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:17.424598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacfaf9-7803-4c04-aabc-c12d470db7e7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:17.430559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173fb6-4102-4dfc-882b-f4056fa756ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:17.431639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173fb6-4102-4dfc-882b-f4056fa756ba admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.432302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173fb6-4102-4dfc-882b-f4056fa756ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.432756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173fb6-4102-4dfc-882b-f4056fa756ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.433884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d173fb6-4102-4dfc-882b-f4056fa756ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:17.436391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d173fb6-4102-4dfc-882b-f4056fa756ba admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:17.557429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 942/1886] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:17 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:17.561944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:17.572875 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d89e0a-7ae7-4d33-b837-165eac2979d8 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:17.635504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2275b8-a0e8-482f-92b4-efe639496cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:17.636446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2275b8-a0e8-482f-92b4-efe639496cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.636556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2275b8-a0e8-482f-92b4-efe639496cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.636809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2275b8-a0e8-482f-92b4-efe639496cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.639347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2275b8-a0e8-482f-92b4-efe639496cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:17.641713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2275b8-a0e8-482f-92b4-efe639496cb2 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:17.741772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 945/1887] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:17 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:17.746788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173fb6-4102-4dfc-882b-f4056fa756ba admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:17.758199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d173fb6-4102-4dfc-882b-f4056fa756ba admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:17.763828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2753314-1977-4065-a7e5-e94b657c3518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:17.764511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2753314-1977-4065-a7e5-e94b657c3518 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.764786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2753314-1977-4065-a7e5-e94b657c3518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.767082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2753314-1977-4065-a7e5-e94b657c3518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.767082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2753314-1977-4065-a7e5-e94b657c3518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:17.767540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2753314-1977-4065-a7e5-e94b657c3518 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:17.778023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 943/1888] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:17.782111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2275b8-a0e8-482f-92b4-efe639496cb2 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:17.794624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2275b8-a0e8-482f-92b4-efe639496cb2 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:17.801888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e94f34-548e-4d4c-82fe-ac521b303b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:17.802569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e94f34-548e-4d4c-82fe-ac521b303b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.802849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e94f34-548e-4d4c-82fe-ac521b303b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.803122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e94f34-548e-4d4c-82fe-ac521b303b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.803770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e94f34-548e-4d4c-82fe-ac521b303b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:17.805588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e94f34-548e-4d4c-82fe-ac521b303b5a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:17.821683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 946/1889] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:17.822931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2753314-1977-4065-a7e5-e94b657c3518 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:17.838328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2753314-1977-4065-a7e5-e94b657c3518 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:17.843642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd070466-cbf5-4717-bc29-4c032938aaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:17.844393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd070466-cbf5-4717-bc29-4c032938aaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:17.844738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd070466-cbf5-4717-bc29-4c032938aaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:17.845439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd070466-cbf5-4717-bc29-4c032938aaa0 admin admin] PATH_INFO: `/v3/projects/772fee760bcc444e99e32813b14b13fd/users/c6ab93d075ae40b1b96fea49c41500d4/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:17.872448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd070466-cbf5-4717-bc29-4c032938aaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772fee760bcc444e99e32813b14b13fd, user_id=c6ab93d075ae40b1b96fea49c41500d4, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:17.875192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd070466-cbf5-4717-bc29-4c032938aaa0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:18.002513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 944/1890] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:17 2022] PUT /identity/v3/projects/772fee760bcc444e99e32813b14b13fd/users/c6ab93d075ae40b1b96fea49c41500d4/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:18.013894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51deb-f873-4688-8281-113dbb584891 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.014183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51deb-f873-4688-8281-113dbb584891 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.014460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51deb-f873-4688-8281-113dbb584891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.044267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-02c51deb-f873-4688-8281-113dbb584891 None None] MFA Rules not processed for user `c6ab93d075ae40b1b96fea49c41500d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:18.045491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-02c51deb-f873-4688-8281-113dbb584891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:18.072453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:18.110986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 947/1891] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:18.115434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd070466-cbf5-4717-bc29-4c032938aaa0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:18.135589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:18.177416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd070466-cbf5-4717-bc29-4c032938aaa0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:18.182206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259216d-b8ca-476f-888f-58b3e193e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:18.182838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259216d-b8ca-476f-888f-58b3e193e4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.183112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259216d-b8ca-476f-888f-58b3e193e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.183381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259216d-b8ca-476f-888f-58b3e193e4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.184000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259216d-b8ca-476f-888f-58b3e193e4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:18.185901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259216d-b8ca-476f-888f-58b3e193e4d4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:18.249855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 945/1892] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:18 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:18.254002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51deb-f873-4688-8281-113dbb584891 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:18.264718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51deb-f873-4688-8281-113dbb584891 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:18.319510 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181586a2-8f38-4c07-9c44-dcb9bb9aecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:18.320106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181586a2-8f38-4c07-9c44-dcb9bb9aecc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.320381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181586a2-8f38-4c07-9c44-dcb9bb9aecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.320650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181586a2-8f38-4c07-9c44-dcb9bb9aecc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.321271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181586a2-8f38-4c07-9c44-dcb9bb9aecc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:18.323305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181586a2-8f38-4c07-9c44-dcb9bb9aecc6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:18.428894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 948/1893] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:18 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:18.430155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259216d-b8ca-476f-888f-58b3e193e4d4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:18.440984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259216d-b8ca-476f-888f-58b3e193e4d4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:18.445497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea910db8-9ee6-40b9-8a4c-2425c6106395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:18.446097 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea910db8-9ee6-40b9-8a4c-2425c6106395 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.446374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea910db8-9ee6-40b9-8a4c-2425c6106395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.446673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea910db8-9ee6-40b9-8a4c-2425c6106395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.447316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea910db8-9ee6-40b9-8a4c-2425c6106395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:18.448895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea910db8-9ee6-40b9-8a4c-2425c6106395 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:18.459747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 946/1894] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:18.463979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181586a2-8f38-4c07-9c44-dcb9bb9aecc6 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:18.473851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181586a2-8f38-4c07-9c44-dcb9bb9aecc6 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:18.478451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44262a9e-b29e-48e7-8117-126687f9dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:18.479144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262a9e-b29e-48e7-8117-126687f9dee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.479426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262a9e-b29e-48e7-8117-126687f9dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.479696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262a9e-b29e-48e7-8117-126687f9dee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.480335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44262a9e-b29e-48e7-8117-126687f9dee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:18.482203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44262a9e-b29e-48e7-8117-126687f9dee7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:18.491922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 949/1895] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:18.495816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea910db8-9ee6-40b9-8a4c-2425c6106395 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:18.505990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea910db8-9ee6-40b9-8a4c-2425c6106395 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:18.510767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599391-e278-4ccb-9535-bd02f9449da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:18.511427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599391-e278-4ccb-9535-bd02f9449da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.511704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599391-e278-4ccb-9535-bd02f9449da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.511975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599391-e278-4ccb-9535-bd02f9449da4 admin admin] PATH_INFO: `/v3/projects/c5c182009b634fa0a939633ac1daa71f/users/83042b2c55a7473091df2684a8fa1d97/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.526969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87599391-e278-4ccb-9535-bd02f9449da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c182009b634fa0a939633ac1daa71f, user_id=83042b2c55a7473091df2684a8fa1d97, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:18.529622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87599391-e278-4ccb-9535-bd02f9449da4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:18.597548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 947/1896] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:18 2022] PUT /identity/v3/projects/c5c182009b634fa0a939633ac1daa71f/users/83042b2c55a7473091df2684a8fa1d97/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:18.607616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577005-7e1e-4753-b848-26529c31c264 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.607896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577005-7e1e-4753-b848-26529c31c264 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.608166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577005-7e1e-4753-b848-26529c31c264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.636325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a2577005-7e1e-4753-b848-26529c31c264 None None] MFA Rules not processed for user `83042b2c55a7473091df2684a8fa1d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:18.637517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a2577005-7e1e-4753-b848-26529c31c264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:18.710249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 950/1897] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:18.725698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599391-e278-4ccb-9535-bd02f9449da4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:18.737210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:18.802536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599391-e278-4ccb-9535-bd02f9449da4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:18.807220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc14b-80b3-45ef-82e3-8b73a8f31bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:18.807834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc14b-80b3-45ef-82e3-8b73a8f31bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.808109 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc14b-80b3-45ef-82e3-8b73a8f31bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.808380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc14b-80b3-45ef-82e3-8b73a8f31bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.809001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bc14b-80b3-45ef-82e3-8b73a8f31bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:18.810925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bc14b-80b3-45ef-82e3-8b73a8f31bc6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:18.825760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:18.924360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 948/1898] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:18 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:18.928091 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577005-7e1e-4753-b848-26529c31c264 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:18.939899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577005-7e1e-4753-b848-26529c31c264 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:18.996659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea49ee-261c-41ae-89c2-631ff4f4894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:18.997119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea49ee-261c-41ae-89c2-631ff4f4894e admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:18.997233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea49ee-261c-41ae-89c2-631ff4f4894e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:18.997444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea49ee-261c-41ae-89c2-631ff4f4894e admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:18.998068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea49ee-261c-41ae-89c2-631ff4f4894e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:19.000060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea49ee-261c-41ae-89c2-631ff4f4894e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:19.079224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 951/1899] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:18 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:19.083741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc14b-80b3-45ef-82e3-8b73a8f31bc6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:19.094955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc14b-80b3-45ef-82e3-8b73a8f31bc6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:19.100078 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8f9f-6f3d-42d0-932f-a9dd3315cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:19.100757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8f9f-6f3d-42d0-932f-a9dd3315cf2e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:19.101125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8f9f-6f3d-42d0-932f-a9dd3315cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:19.101470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8f9f-6f3d-42d0-932f-a9dd3315cf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:19.102182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb8f9f-6f3d-42d0-932f-a9dd3315cf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:19.103869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb8f9f-6f3d-42d0-932f-a9dd3315cf2e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:19.115822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 949/1900] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:19.120182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea49ee-261c-41ae-89c2-631ff4f4894e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:19.130896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea49ee-261c-41ae-89c2-631ff4f4894e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:19.135708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf5bc9-91dd-4f25-b689-20df2c45027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:19.136363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf5bc9-91dd-4f25-b689-20df2c45027f admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:19.136640 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf5bc9-91dd-4f25-b689-20df2c45027f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:19.136922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf5bc9-91dd-4f25-b689-20df2c45027f admin admin] PATH_INFO: `/v3/projects/e2ea092bdae349c187b2a1812cdc7b66/users/6770697a1535479fbfd0f636d998ce23/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:19.153157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf5bc9-91dd-4f25-b689-20df2c45027f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ea092bdae349c187b2a1812cdc7b66, user_id=6770697a1535479fbfd0f636d998ce23, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:19.155755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf5bc9-91dd-4f25-b689-20df2c45027f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:19.260665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 952/1901] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:19 2022] PUT /identity/v3/projects/e2ea092bdae349c187b2a1812cdc7b66/users/6770697a1535479fbfd0f636d998ce23/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:19.264563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8f9f-6f3d-42d0-932f-a9dd3315cf2e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:19.274503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8f9f-6f3d-42d0-932f-a9dd3315cf2e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:19.330596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e4825-5255-4a41-a108-1f1f45614b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:19.331202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e4825-5255-4a41-a108-1f1f45614b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:19.331484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e4825-5255-4a41-a108-1f1f45614b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:19.331771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e4825-5255-4a41-a108-1f1f45614b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:19.332434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e4825-5255-4a41-a108-1f1f45614b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:19.334009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e4825-5255-4a41-a108-1f1f45614b43 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:19.343794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 950/1902] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:19.348549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf5bc9-91dd-4f25-b689-20df2c45027f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:19.358783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf5bc9-91dd-4f25-b689-20df2c45027f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:19.364104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:19.364757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:19.373058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:19.373058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] PATH_INFO: `/v3/projects/e2ea092bdae349c187b2a1812cdc7b66/users/6770697a1535479fbfd0f636d998ce23/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:19.373058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ea092bdae349c187b2a1812cdc7b66, user_id=6770697a1535479fbfd0f636d998ce23, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:19.373058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:19.380345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 953/1903] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:19 2022] PUT /identity/v3/projects/e2ea092bdae349c187b2a1812cdc7b66/users/6770697a1535479fbfd0f636d998ce23/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:19.390387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9f9d-8baa-4c39-a06c-acb13f9531a2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:19.390715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9f9d-8baa-4c39-a06c-acb13f9531a2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:19.390986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9f9d-8baa-4c39-a06c-acb13f9531a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:19.421428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e78f9f9d-8baa-4c39-a06c-acb13f9531a2 None None] MFA Rules not processed for user `6770697a1535479fbfd0f636d998ce23`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:19.422699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e78f9f9d-8baa-4c39-a06c-acb13f9531a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:19.487962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 951/1904] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:19.498985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:19.500654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:19.557688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dcc8f-7c5b-46e5-8145-c5c0c32af323 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:19.561469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de033b32-9f52-475d-ae86-1692ba3f1df1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:19.562080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de033b32-9f52-475d-ae86-1692ba3f1df1 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:19.562341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de033b32-9f52-475d-ae86-1692ba3f1df1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:19.562639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de033b32-9f52-475d-ae86-1692ba3f1df1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:19.571717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de033b32-9f52-475d-ae86-1692ba3f1df1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:19.573193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de033b32-9f52-475d-ae86-1692ba3f1df1 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:19.583499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 954/1905] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:19.615139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:19.691488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f9f9d-8baa-4c39-a06c-acb13f9531a2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:19.692874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e78f9f9d-8baa-4c39-a06c-acb13f9531a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:19.695238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:19.705729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f9f9d-8baa-4c39-a06c-acb13f9531a2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:19.709551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:19.710156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:19.710435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:19.710723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:19.769712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:19.770949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:19.781136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 952/1906] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:19.901680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:20.078245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:20.152082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:20.381629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:20.525253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:20.952385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:21.364019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:21.844250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de033b32-9f52-475d-ae86-1692ba3f1df1 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:21.851134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de033b32-9f52-475d-ae86-1692ba3f1df1 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:21.861933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83bd63-6113-47f2-887a-66136373ac11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:21.862641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bd63-6113-47f2-887a-66136373ac11 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:21.863026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bd63-6113-47f2-887a-66136373ac11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:21.863315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bd63-6113-47f2-887a-66136373ac11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:21.865625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0b83bd63-6113-47f2-887a-66136373ac11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:21.923833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:21.944839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83bd63-6113-47f2-887a-66136373ac11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:21.946378 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83bd63-6113-47f2-887a-66136373ac11 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:21.956772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 955/1907] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:21.987193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:22.545178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:22.547208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:22.641002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b6f3e-269b-4833-a243-18da12c5e627 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:22.646388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:22.647061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:22.647340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:22.647877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] PATH_INFO: `/v3/users/bf8467a1494440bdb91f81c7265d13e0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:22.648735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8467a1494440bdb91f81c7265d13e0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:22.650676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:22.666303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:22.747246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:22.878645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8467a1494440bdb91f81c7265d13e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:22.985463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8467a1494440bdb91f81c7265d13e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:22.993070 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8467a1494440bdb91f81c7265d13e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:23.006497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8467a1494440bdb91f81c7265d13e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:23.007497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8467a1494440bdb91f81c7265d13e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:23.021083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 953/1908] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:22 2022] DELETE /identity/v3/users/bf8467a1494440bdb91f81c7265d13e0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:23.024832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26096d-5a74-4ba2-88b4-f32166500f26 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:23.025545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26096d-5a74-4ba2-88b4-f32166500f26 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:23.025545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26096d-5a74-4ba2-88b4-f32166500f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:23.046392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8b26096d-5a74-4ba2-88b4-f32166500f26 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:23.049133 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8b26096d-5a74-4ba2-88b4-f32166500f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:23.118363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:23.126546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 956/1909] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:23.141017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:23.143929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:23.216874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590ee6-6c2a-47b4-a70d-a30a43a6512f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:23.220886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6a51-41de-4948-bd4c-2733bb7170d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:23.226219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6a51-41de-4948-bd4c-2733bb7170d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:23.226219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6a51-41de-4948-bd4c-2733bb7170d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:23.226219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6a51-41de-4948-bd4c-2733bb7170d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:23.232585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e6a51-41de-4948-bd4c-2733bb7170d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:23.234048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e6a51-41de-4948-bd4c-2733bb7170d8 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:23.254396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 954/1910] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:23.398102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:23.816163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26096d-5a74-4ba2-88b4-f32166500f26 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:23.817683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8b26096d-5a74-4ba2-88b4-f32166500f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:23.831124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26096d-5a74-4ba2-88b4-f32166500f26 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:23.836086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:23.837033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:23.837469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:23.838152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] PATH_INFO: `/v3/projects/6873025964e34776bf949db2a5a368b4` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:23.839380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6873025964e34776bf949db2a5a368b4)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:23.842014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:24.019033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6873025964e34776bf949db2a5a368b4', 'request_id': 'req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.035218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6873025964e34776bf949db2a5a368b4', 'request_id': 'req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.044071 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6873025964e34776bf949db2a5a368b4', 'request_id': 'req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.079018 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:24.122768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] The token cache is being invalidate because project 6873025964e34776bf949db2a5a368b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:24.124888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.125807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.129723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 957/1911] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:23 2022] DELETE /identity/v3/projects/6873025964e34776bf949db2a5a368b4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:24.144349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6a51-41de-4948-bd4c-2733bb7170d8 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:24.158933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6a51-41de-4948-bd4c-2733bb7170d8 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:24.227396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:24.228394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:24.228943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:24.229419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] PATH_INFO: `/v3/users/c4e591869c664ae19148dd42754af7e0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:24.231501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e591869c664ae19148dd42754af7e0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:24.234921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:24.369517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:24.458684 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e591869c664ae19148dd42754af7e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.528797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e591869c664ae19148dd42754af7e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.536352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e591869c664ae19148dd42754af7e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.547931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e591869c664ae19148dd42754af7e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.548566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e591869c664ae19148dd42754af7e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:24.554332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 955/1912] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:24 2022] DELETE /identity/v3/users/c4e591869c664ae19148dd42754af7e0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:25.125058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:25.127981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:25.142725 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc2d7-bdb3-4783-bd10-55b3775c2dc3 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:25.212120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:25.212788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.219082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.219082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] PATH_INFO: `/v3/projects/f2ad4d7a0261420aab4b9d3cc4a000c7` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.219082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ad4d7a0261420aab4b9d3cc4a000c7)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:25.219082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:25.233466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:25.235086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:25.252919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8ab2-1e65-48ae-8282-9d75b156b6d0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:25.258760 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:25.260993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.261274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.261546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] PATH_INFO: `/v3/users/c6ab93d075ae40b1b96fea49c41500d4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.262826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ab93d075ae40b1b96fea49c41500d4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:25.264797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:25.272588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:25.411568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ad4d7a0261420aab4b9d3cc4a000c7', 'request_id': 'req-24dc9890-610d-4de5-91e8-3ce9394f51e4'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.417637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ad4d7a0261420aab4b9d3cc4a000c7', 'request_id': 'req-24dc9890-610d-4de5-91e8-3ce9394f51e4'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.425300 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ad4d7a0261420aab4b9d3cc4a000c7', 'request_id': 'req-24dc9890-610d-4de5-91e8-3ce9394f51e4'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.500175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] The token cache is being invalidate because project f2ad4d7a0261420aab4b9d3cc4a000c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:25.500462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.501243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.507650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 958/1913] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:25 2022] DELETE /identity/v3/projects/f2ad4d7a0261420aab4b9d3cc4a000c7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:25.508738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:25.510232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:25.513313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ab93d075ae40b1b96fea49c41500d4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.600344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc9890-610d-4de5-91e8-3ce9394f51e4 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:25.608628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ab93d075ae40b1b96fea49c41500d4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.609379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:25.610025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.610346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.610775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] PATH_INFO: `/v3/users/6e4b9fe7494144529ea899a5910fe691` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.616261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4b9fe7494144529ea899a5910fe691)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:25.616261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:25.617900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ab93d075ae40b1b96fea49c41500d4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.630927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ab93d075ae40b1b96fea49c41500d4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.631838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-18bedaae-0fc7-4677-9b11-a6163081c81e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ab93d075ae40b1b96fea49c41500d4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.635275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:25.641353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 956/1914] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:25 2022] DELETE /identity/v3/users/c6ab93d075ae40b1b96fea49c41500d4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:25.641353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068e8bf-63a1-4fd1-8651-73c9c2245a6d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.641353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068e8bf-63a1-4fd1-8651-73c9c2245a6d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.641353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068e8bf-63a1-4fd1-8651-73c9c2245a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.663200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b068e8bf-63a1-4fd1-8651-73c9c2245a6d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:25.664639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b068e8bf-63a1-4fd1-8651-73c9c2245a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:25.725238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 957/1915] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:25.726528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6404ae0-6e97-4a71-b228-24d0386fd50e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.726818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6404ae0-6e97-4a71-b228-24d0386fd50e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.727095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6404ae0-6e97-4a71-b228-24d0386fd50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.745866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d6404ae0-6e97-4a71-b228-24d0386fd50e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:25.747088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6404ae0-6e97-4a71-b228-24d0386fd50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:25.754924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 958/1916] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:25.756172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1e1c-bff4-46af-b09a-d02b24e19a86 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.756450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1e1c-bff4-46af-b09a-d02b24e19a86 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.756719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1e1c-bff4-46af-b09a-d02b24e19a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.777657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-130e1e1c-bff4-46af-b09a-d02b24e19a86 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:25.778959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-130e1e1c-bff4-46af-b09a-d02b24e19a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:25.787753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 959/1917] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:25.788511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e1e1c-bff4-46af-b09a-d02b24e19a86 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:25.789691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-130e1e1c-bff4-46af-b09a-d02b24e19a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:25.842556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e1e1c-bff4-46af-b09a-d02b24e19a86 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:25.846869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d935c3-db3f-4aef-a3ea-f88b8c37c56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:25.847505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d935c3-db3f-4aef-a3ea-f88b8c37c56b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.847798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d935c3-db3f-4aef-a3ea-f88b8c37c56b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.848067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d935c3-db3f-4aef-a3ea-f88b8c37c56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.857273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d935c3-db3f-4aef-a3ea-f88b8c37c56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:25.858855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d935c3-db3f-4aef-a3ea-f88b8c37c56b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:25.868177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 960/1918] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:25.868950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d935c3-db3f-4aef-a3ea-f88b8c37c56b service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:25.878460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d935c3-db3f-4aef-a3ea-f88b8c37c56b service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:25.883235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:25.883841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.884123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.884386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.885230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:25.885486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:25.887257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:25.899931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 961/1919] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:25.905404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:25.918872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4b9fe7494144529ea899a5910fe691'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.924622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67551f8b-9ce6-40e1-b1c1-73605ba3813d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:25.933163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:25.934392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:25.934702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:25.935112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:25.935407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4b9fe7494144529ea899a5910fe691'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:25.936050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:25.942788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:26.028425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:26.033852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4b9fe7494144529ea899a5910fe691'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:26.035811 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4b9fe7494144529ea899a5910fe691'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:26.039061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 962/1920] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:25 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:26.043965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:26.046368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:26.075549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a0bee460-9c32-4e20-b912-a368383aaf97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4b9fe7494144529ea899a5910fe691'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:26.118848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 959/1921] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:25 2022] DELETE /identity/v3/users/6e4b9fe7494144529ea899a5910fe691 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:26.123261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db788c7-4141-443f-95f7-42d263fea9be None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.123546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db788c7-4141-443f-95f7-42d263fea9be None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.124444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db788c7-4141-443f-95f7-42d263fea9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.162069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3db788c7-4141-443f-95f7-42d263fea9be None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:26.164125 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3db788c7-4141-443f-95f7-42d263fea9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:26.168953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0351139-dde5-4fec-8c0d-142e0711823d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:26.246252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:26.246962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.247180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.247594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.248280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:26.250611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:26.258104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 960/1922] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:26.266616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db788c7-4141-443f-95f7-42d263fea9be None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:26.268768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3db788c7-4141-443f-95f7-42d263fea9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:26.328443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db788c7-4141-443f-95f7-42d263fea9be None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:26.335133 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497faf1-ede2-483f-9e27-f4f8bac46f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:26.335691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497faf1-ede2-483f-9e27-f4f8bac46f67 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.336116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497faf1-ede2-483f-9e27-f4f8bac46f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.336274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497faf1-ede2-483f-9e27-f4f8bac46f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.347646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 963/1923] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:26 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:26.353609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:26.355118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497faf1-ede2-483f-9e27-f4f8bac46f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:26.357257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497faf1-ede2-483f-9e27-f4f8bac46f67 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:26.363841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:26.383245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 961/1924] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:26.383245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497faf1-ede2-483f-9e27-f4f8bac46f67 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:26.391370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497faf1-ede2-483f-9e27-f4f8bac46f67 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:26.392890 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3332b-cf63-4607-98ef-fe2231b1235b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:26.396560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0791d-c026-4d9a-b69e-45df39b56d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:26.397290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0791d-c026-4d9a-b69e-45df39b56d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.397571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0791d-c026-4d9a-b69e-45df39b56d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.397837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0791d-c026-4d9a-b69e-45df39b56d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.398493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0791d-c026-4d9a-b69e-45df39b56d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:26.400085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0791d-c026-4d9a-b69e-45df39b56d33 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:26.407169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:26.408707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.408949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.409233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] PATH_INFO: `/v3/projects/772fee760bcc444e99e32813b14b13fd` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.414423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 962/1925] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:26.414704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772fee760bcc444e99e32813b14b13fd)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:26.415376 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0791d-c026-4d9a-b69e-45df39b56d33 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:26.415982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:26.428507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0791d-c026-4d9a-b69e-45df39b56d33 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:26.433916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914494a-4bf7-4cf9-9f50-664542fd0228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:26.434561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914494a-4bf7-4cf9-9f50-664542fd0228 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.434837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914494a-4bf7-4cf9-9f50-664542fd0228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.435168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914494a-4bf7-4cf9-9f50-664542fd0228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.436028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914494a-4bf7-4cf9-9f50-664542fd0228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:26.438145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914494a-4bf7-4cf9-9f50-664542fd0228 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:26.451327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 963/1926] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:26.457985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914494a-4bf7-4cf9-9f50-664542fd0228 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:26.468036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914494a-4bf7-4cf9-9f50-664542fd0228 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:26.473307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014488a-437a-467e-9665-b5c483acb30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:26.473959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014488a-437a-467e-9665-b5c483acb30c admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.474234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014488a-437a-467e-9665-b5c483acb30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.474534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014488a-437a-467e-9665-b5c483acb30c admin admin] PATH_INFO: `/v3/projects/3cf8248e522d49d48c14cd031e05de5d/users/a677457298d3482481a40789ccad93b2/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.483325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:26.490199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014488a-437a-467e-9665-b5c483acb30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf8248e522d49d48c14cd031e05de5d, user_id=a677457298d3482481a40789ccad93b2, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:26.492749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014488a-437a-467e-9665-b5c483acb30c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:26.585008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 964/1927] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:26 2022] PUT /identity/v3/projects/3cf8248e522d49d48c14cd031e05de5d/users/a677457298d3482481a40789ccad93b2/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:26.591445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772fee760bcc444e99e32813b14b13fd', 'request_id': 'req-61290888-e8f2-4277-941e-54c5f0c635e8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:26.596256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c714-f24f-4c66-9a2e-02e4b4c9aa75 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.596629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c714-f24f-4c66-9a2e-02e4b4c9aa75 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.596878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8c714-f24f-4c66-9a2e-02e4b4c9aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.630545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a7a8c714-f24f-4c66-9a2e-02e4b4c9aa75 None None] MFA Rules not processed for user `a677457298d3482481a40789ccad93b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:26.634646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a7a8c714-f24f-4c66-9a2e-02e4b4c9aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:26.712267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772fee760bcc444e99e32813b14b13fd', 'request_id': 'req-61290888-e8f2-4277-941e-54c5f0c635e8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:26.723689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 965/1928] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:26.724450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772fee760bcc444e99e32813b14b13fd', 'request_id': 'req-61290888-e8f2-4277-941e-54c5f0c635e8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:26.728428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8c714-f24f-4c66-9a2e-02e4b4c9aa75 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:26.739913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:26.746249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] The token cache is being invalidate because project 772fee760bcc444e99e32813b14b13fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:26.754845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:26.754845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:26.754845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 964/1929] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:26 2022] DELETE /identity/v3/projects/772fee760bcc444e99e32813b14b13fd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:26.757529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:26.759060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:26.820286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8c714-f24f-4c66-9a2e-02e4b4c9aa75 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:26.827468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:26.828610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.829344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.830513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.832126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:26.834430 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:26.871680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61290888-e8f2-4277-941e-54c5f0c635e8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:26.877863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:26.878663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:26.879019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:26.879312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] PATH_INFO: `/v3/users/83042b2c55a7473091df2684a8fa1d97` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:26.880552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] RBAC: Authorizing `identity:delete_user(user_id=83042b2c55a7473091df2684a8fa1d97)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:26.882812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.035358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 966/1930] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:26 2022] POST /identity/v3/projects => generated 389 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:27.044943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.046602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:27.127756 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da742-10cc-4192-b5a2-cb88601c63ac admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.129777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.130384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.130693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.130963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.131575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.133662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.183228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83042b2c55a7473091df2684a8fa1d97'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.248789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83042b2c55a7473091df2684a8fa1d97'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.256779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83042b2c55a7473091df2684a8fa1d97'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.260338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 967/1931] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:27 2022] POST /identity/v3/users => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:27.260338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.260918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:27.262580 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:27.272146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83042b2c55a7473091df2684a8fa1d97'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.272933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83042b2c55a7473091df2684a8fa1d97'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.282041 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549efdf-4a44-4ff2-972e-97d952795373 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.287439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.288119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.288396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.288663 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] PATH_INFO: `/v3/projects/c2acaa47c7834b38bfa1c462da6862b1` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.289814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2acaa47c7834b38bfa1c462da6862b1)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.291758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.300255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 965/1932] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:26 2022] DELETE /identity/v3/users/83042b2c55a7473091df2684a8fa1d97 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:27.301122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.307908 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:27.398163 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3f26-2fe1-4750-9320-f2b2de1d43af admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.403270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c991-0dc2-4878-80de-7078c8d4d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.404125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c991-0dc2-4878-80de-7078c8d4d22f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.404404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c991-0dc2-4878-80de-7078c8d4d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.404671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132c991-0dc2-4878-80de-7078c8d4d22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.405463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132c991-0dc2-4878-80de-7078c8d4d22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.407231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132c991-0dc2-4878-80de-7078c8d4d22f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.418555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 966/1933] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:27.422657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c991-0dc2-4878-80de-7078c8d4d22f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.433481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132c991-0dc2-4878-80de-7078c8d4d22f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.436529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2acaa47c7834b38bfa1c462da6862b1', 'request_id': 'req-0a44f765-4ca2-4a52-a7be-c274f8491940'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.443583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2acaa47c7834b38bfa1c462da6862b1', 'request_id': 'req-0a44f765-4ca2-4a52-a7be-c274f8491940'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.452357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2acaa47c7834b38bfa1c462da6862b1', 'request_id': 'req-0a44f765-4ca2-4a52-a7be-c274f8491940'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.490000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.490683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.490954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.491241 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] PATH_INFO: `/v3/projects/d9df686c21b34eef95823f3b4c1d6c21/users/83193ed789f9498c9634b3ef2c145493/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.505408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9df686c21b34eef95823f3b4c1d6c21, user_id=83193ed789f9498c9634b3ef2c145493, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.508162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.535886 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] The token cache is being invalidate because project c2acaa47c7834b38bfa1c462da6862b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:27.536231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.537452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0a44f765-4ca2-4a52-a7be-c274f8491940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:27.539355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 968/1934] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:27 2022] DELETE /identity/v3/projects/c2acaa47c7834b38bfa1c462da6862b1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:27.543567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c32e-f55d-493b-b234-6e2808761a55 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.546707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c32e-f55d-493b-b234-6e2808761a55 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.546707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c32e-f55d-493b-b234-6e2808761a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.570403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3043c32e-f55d-493b-b234-6e2808761a55 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:27.571722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3043c32e-f55d-493b-b234-6e2808761a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:27.583659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 969/1935] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:27.592503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6bfc-c31d-4b37-af62-18484d5802c4 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.594727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6bfc-c31d-4b37-af62-18484d5802c4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.594727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6bfc-c31d-4b37-af62-18484d5802c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.594905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 967/1936] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:27 2022] PUT /identity/v3/projects/d9df686c21b34eef95823f3b4c1d6c21/users/83193ed789f9498c9634b3ef2c145493/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:27.600062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.601923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:27.625923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-6d1d6bfc-c31d-4b37-af62-18484d5802c4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:27.627799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6d1d6bfc-c31d-4b37-af62-18484d5802c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:27.674788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:27.711356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc5db4-93bc-4719-868e-0c18ee2b6ff4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.716788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281d387-4fe3-4a39-9f23-77f6bf718366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.717762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d387-4fe3-4a39-9f23-77f6bf718366 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.718298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d387-4fe3-4a39-9f23-77f6bf718366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.718865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281d387-4fe3-4a39-9f23-77f6bf718366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.719530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281d387-4fe3-4a39-9f23-77f6bf718366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.721126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 970/1937] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:27.723261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281d387-4fe3-4a39-9f23-77f6bf718366 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.727438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d6bfc-c31d-4b37-af62-18484d5802c4 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.734749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 968/1938] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:27.738735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281d387-4fe3-4a39-9f23-77f6bf718366 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.741963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d6bfc-c31d-4b37-af62-18484d5802c4 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.750712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.751417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.752292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.752658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.753409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:27.753806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.756008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281d387-4fe3-4a39-9f23-77f6bf718366 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.756310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.763941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.764809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.765284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.765564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] PATH_INFO: `/v3/projects/d9df686c21b34eef95823f3b4c1d6c21/users/83193ed789f9498c9634b3ef2c145493/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.771001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9df686c21b34eef95823f3b4c1d6c21, user_id=83193ed789f9498c9634b3ef2c145493, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.771087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.790226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 969/1939] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:27 2022] PUT /identity/v3/projects/d9df686c21b34eef95823f3b4c1d6c21/users/83193ed789f9498c9634b3ef2c145493/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:27.791387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.793850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:27.800642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 971/1940] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:42:27.803826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:27.819544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a2133-a3ed-4337-a812-e810b371e2d9 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.875910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199635c5-3575-4882-b2b5-c01674f4e2c1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:27.881609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.881854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79e6c3-12c7-4849-b75f-23f10d9f42b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:27.882400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.882545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e6c3-12c7-4849-b75f-23f10d9f42b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:27.882916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.883029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e6c3-12c7-4849-b75f-23f10d9f42b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:27.883205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e6c3-12c7-4849-b75f-23f10d9f42b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.883321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] PATH_INFO: `/v3/projects/c5c182009b634fa0a939633ac1daa71f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:27.883855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79e6c3-12c7-4849-b75f-23f10d9f42b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.884744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c182009b634fa0a939633ac1daa71f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:27.886038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79e6c3-12c7-4849-b75f-23f10d9f42b0 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:27.887006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:28.008118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:28.009555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 972/1941] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:27 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:28.014196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d0eeb-8565-4755-9b12-c15a7b5c6df2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.015642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d0eeb-8565-4755-9b12-c15a7b5c6df2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.015642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d0eeb-8565-4755-9b12-c15a7b5c6df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.041681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c182009b634fa0a939633ac1daa71f', 'request_id': 'req-88fb4539-4b92-483e-a147-b27955b64ed7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.070233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-089d0eeb-8565-4755-9b12-c15a7b5c6df2 None None] MFA Rules not processed for user `83193ed789f9498c9634b3ef2c145493`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:28.071601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-089d0eeb-8565-4755-9b12-c15a7b5c6df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:28.134848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c182009b634fa0a939633ac1daa71f', 'request_id': 'req-88fb4539-4b92-483e-a147-b27955b64ed7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.142881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c182009b634fa0a939633ac1daa71f', 'request_id': 'req-88fb4539-4b92-483e-a147-b27955b64ed7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.153756 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 973/1942] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:28.154819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d0eeb-8565-4755-9b12-c15a7b5c6df2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:28.171509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] The token cache is being invalidate because project c5c182009b634fa0a939633ac1daa71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:28.171813 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.172839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.174437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 970/1943] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:27 2022] DELETE /identity/v3/projects/c5c182009b634fa0a939633ac1daa71f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:28.177556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:28.179818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:28.231626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d0eeb-8565-4755-9b12-c15a7b5c6df2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:28.238684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:28.239908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.240502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.240502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.241317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:28.244192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:28.270626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb4539-4b92-483e-a147-b27955b64ed7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:28.318761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:28.319419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.319703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.320002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.321786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:28.334058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:28.335524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:28.344931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 971/1945] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:28.345073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 974/1945] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:28 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:28.345817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:28.349323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:28.349450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:28.351058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:28.367087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa777f70-ffa2-4eba-982f-3f2ef4f8c67b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:28.367969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d3499-5072-4276-8138-9d261c6f7899 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:28.370422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c440-c84f-45e4-b49d-1ecdcd2103fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:28.371229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c440-c84f-45e4-b49d-1ecdcd2103fe admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.371356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c440-c84f-45e4-b49d-1ecdcd2103fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.371629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c440-c84f-45e4-b49d-1ecdcd2103fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.372273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c440-c84f-45e4-b49d-1ecdcd2103fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:28.373178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:28.373806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.373906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c440-c84f-45e4-b49d-1ecdcd2103fe admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:28.374083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.374351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] PATH_INFO: `/v3/users/6770697a1535479fbfd0f636d998ce23` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.375519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6770697a1535479fbfd0f636d998ce23)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:28.377970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:28.386885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 975/1946] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:28.390701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c440-c84f-45e4-b49d-1ecdcd2103fe admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:28.401063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c440-c84f-45e4-b49d-1ecdcd2103fe admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:28.406007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014febb-5bb8-4c58-b183-87a3867b3edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:28.407317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014febb-5bb8-4c58-b183-87a3867b3edf admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.407670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014febb-5bb8-4c58-b183-87a3867b3edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.408038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014febb-5bb8-4c58-b183-87a3867b3edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.408749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014febb-5bb8-4c58-b183-87a3867b3edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:28.411139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014febb-5bb8-4c58-b183-87a3867b3edf admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:28.422692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 976/1947] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:28.427171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014febb-5bb8-4c58-b183-87a3867b3edf admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:28.437823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014febb-5bb8-4c58-b183-87a3867b3edf admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:28.448355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:28.449040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.449324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.449618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] PATH_INFO: `/v3/projects/784c937dbfdc48edbe5f4cb48ad24fd2/users/b86d11f77f7a459dbaa8e86bb469301a/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.472644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784c937dbfdc48edbe5f4cb48ad24fd2, user_id=b86d11f77f7a459dbaa8e86bb469301a, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:28.475930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:28.558281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 977/1948] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:28 2022] PUT /identity/v3/projects/784c937dbfdc48edbe5f4cb48ad24fd2/users/b86d11f77f7a459dbaa8e86bb469301a/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:28.558950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:28.560545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:28.628272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a3ff8-b0a4-4bbc-8db8-4247c3bceed6 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:28.631802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:28.632385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.632665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.632937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] PATH_INFO: `/v3/users/a677457298d3482481a40789ccad93b2` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.634212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a677457298d3482481a40789ccad93b2)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:28.637783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:28.676927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6770697a1535479fbfd0f636d998ce23'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.831776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6770697a1535479fbfd0f636d998ce23'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.839289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6770697a1535479fbfd0f636d998ce23'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.851138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6770697a1535479fbfd0f636d998ce23'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.851795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0fb281a7-489f-45cc-ae98-8945642ed555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6770697a1535479fbfd0f636d998ce23'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.857508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 972/1949] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:28 2022] DELETE /identity/v3/users/6770697a1535479fbfd0f636d998ce23 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:28.858728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55db21-ecfd-4d1f-b2cf-3a5870b97bd4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:28.859007 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55db21-ecfd-4d1f-b2cf-3a5870b97bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:28.859274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55db21-ecfd-4d1f-b2cf-3a5870b97bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:28.887933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5d55db21-ecfd-4d1f-b2cf-3a5870b97bd4 None None] MFA Rules not processed for user `b86d11f77f7a459dbaa8e86bb469301a`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:28.889061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5d55db21-ecfd-4d1f-b2cf-3a5870b97bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:28.957472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a677457298d3482481a40789ccad93b2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.964791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a677457298d3482481a40789ccad93b2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:28.966800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 973/1950] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:28.978028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55db21-ecfd-4d1f-b2cf-3a5870b97bd4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:28.979387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5d55db21-ecfd-4d1f-b2cf-3a5870b97bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.010670 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:29.036618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55db21-ecfd-4d1f-b2cf-3a5870b97bd4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:29.040265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:29.040864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.041144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.041419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.049901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a677457298d3482481a40789ccad93b2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.050602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a677457298d3482481a40789ccad93b2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.051967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:29.053590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:29.064203 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 974/1951] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:29.069246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e9f82302-01c2-44ab-a960-ab26f2389ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a677457298d3482481a40789ccad93b2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.082533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 978/1952] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:28 2022] DELETE /identity/v3/users/a677457298d3482481a40789ccad93b2 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:29.084278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:29.085195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef99dda-8ba6-4bd4-85ce-2546fcb97f05 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.085487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef99dda-8ba6-4bd4-85ce-2546fcb97f05 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.085761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef99dda-8ba6-4bd4-85ce-2546fcb97f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.086372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.128027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-cef99dda-8ba6-4bd4-85ce-2546fcb97f05 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:29.129499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cef99dda-8ba6-4bd4-85ce-2546fcb97f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.165821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:29.173505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3450b-d9de-43d9-a711-de218bf66272 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:29.206624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 979/1953] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:29.215377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef99dda-8ba6-4bd4-85ce-2546fcb97f05 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:29.217173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cef99dda-8ba6-4bd4-85ce-2546fcb97f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.271020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:29.271693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.271970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.272239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] PATH_INFO: `/v3/users/17aabc97edbd44f08ca2ea0c623b368e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.274165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17aabc97edbd44f08ca2ea0c623b368e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:29.280238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:29.298022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef99dda-8ba6-4bd4-85ce-2546fcb97f05 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:29.308558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:29.309198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.309608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.309982 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.331778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:29.333442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:29.352553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 980/1954] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:29.391646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:29.393867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.431691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79a0cd-6b22-406b-83d8-4030d0adca0a service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:29.442710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:29.458065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.458447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.464146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] PATH_INFO: `/v3/projects/e2ea092bdae349c187b2a1812cdc7b66` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.465888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ea092bdae349c187b2a1812cdc7b66)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:29.467695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:29.510893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17aabc97edbd44f08ca2ea0c623b368e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.572135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ea092bdae349c187b2a1812cdc7b66', 'request_id': 'req-1286aa81-b3c8-4425-8c40-63de477d2794'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.578095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ea092bdae349c187b2a1812cdc7b66', 'request_id': 'req-1286aa81-b3c8-4425-8c40-63de477d2794'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.585407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ea092bdae349c187b2a1812cdc7b66', 'request_id': 'req-1286aa81-b3c8-4425-8c40-63de477d2794'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.614259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17aabc97edbd44f08ca2ea0c623b368e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.621757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17aabc97edbd44f08ca2ea0c623b368e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.634126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17aabc97edbd44f08ca2ea0c623b368e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.634901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eff2afb9-4570-4931-a072-a926b64271b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17aabc97edbd44f08ca2ea0c623b368e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.641373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 975/1955] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:29 2022] DELETE /identity/v3/users/17aabc97edbd44f08ca2ea0c623b368e => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:29.645641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eecf3-1192-4021-94f2-22d23465d7cf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.645928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eecf3-1192-4021-94f2-22d23465d7cf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.646353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eecf3-1192-4021-94f2-22d23465d7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.681083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7a9eecf3-1192-4021-94f2-22d23465d7cf None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:29.682594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7a9eecf3-1192-4021-94f2-22d23465d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.749958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] The token cache is being invalidate because project e2ea092bdae349c187b2a1812cdc7b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:29.750251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.751042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1286aa81-b3c8-4425-8c40-63de477d2794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:29.752547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 981/1956] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:29 2022] DELETE /identity/v3/projects/e2ea092bdae349c187b2a1812cdc7b66 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:29.763750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8731-002c-4562-9770-8e35f1eedf36 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.765015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 976/1957] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:29.768614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8731-002c-4562-9770-8e35f1eedf36 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.768944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8731-002c-4562-9770-8e35f1eedf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.774530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eecf3-1192-4021-94f2-22d23465d7cf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:29.776643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7a9eecf3-1192-4021-94f2-22d23465d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.782123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:29.796608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-fbfc8731-002c-4562-9770-8e35f1eedf36 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:29.797853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fbfc8731-002c-4562-9770-8e35f1eedf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.815643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 982/1958] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:29.828467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe39c-4dff-4795-b056-8e50754f4797 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.828769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe39c-4dff-4795-b056-8e50754f4797 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.829174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe39c-4dff-4795-b056-8e50754f4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.855412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-5ddbe39c-4dff-4795-b056-8e50754f4797 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:29.859446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5ddbe39c-4dff-4795-b056-8e50754f4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:29.877328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eecf3-1192-4021-94f2-22d23465d7cf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:29.895531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e0cc-d21b-4779-a197-5271e0994fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:29.896682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e0cc-d21b-4779-a197-5271e0994fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.896980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e0cc-d21b-4779-a197-5271e0994fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.897237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e0cc-d21b-4779-a197-5271e0994fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.898807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 983/1959] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:29.903685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe39c-4dff-4795-b056-8e50754f4797 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:29.909793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498e0cc-d21b-4779-a197-5271e0994fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:29.911098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498e0cc-d21b-4779-a197-5271e0994fb7 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:29.926592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 977/1960] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:29.966830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe39c-4dff-4795-b056-8e50754f4797 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:29.978174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:29.980399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:29.980859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:29.982556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:29.983464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:29.984033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:29.988774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.010876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 984/1961] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:30.016434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e0cc-d21b-4779-a197-5271e0994fb7 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:30.028295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e0cc-d21b-4779-a197-5271e0994fb7 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:30.035068 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5abc7-73e4-487a-8d07-190daf9d95bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:30.035687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5abc7-73e4-487a-8d07-190daf9d95bb admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.036040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5abc7-73e4-487a-8d07-190daf9d95bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.036324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5abc7-73e4-487a-8d07-190daf9d95bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.037545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5abc7-73e4-487a-8d07-190daf9d95bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:30.039487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5abc7-73e4-487a-8d07-190daf9d95bb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.109619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:30.111411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:30.133238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d19a2-fbbc-4728-b8e0-d2ce29a91c2a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:30.140548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:30.141313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.141910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.142978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] PATH_INFO: `/v3/projects/3cf8248e522d49d48c14cd031e05de5d` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.144466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf8248e522d49d48c14cd031e05de5d)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:30.147246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.152097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:30.166447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 978/1962] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:30 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:30.170580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5abc7-73e4-487a-8d07-190daf9d95bb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:30.247910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5abc7-73e4-487a-8d07-190daf9d95bb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:30.257447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38b4d-067e-490b-8588-115b04668917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:30.258614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38b4d-067e-490b-8588-115b04668917 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.259961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38b4d-067e-490b-8588-115b04668917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.260338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38b4d-067e-490b-8588-115b04668917 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.260974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f38b4d-067e-490b-8588-115b04668917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:30.263041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f38b4d-067e-490b-8588-115b04668917 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.302713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf8248e522d49d48c14cd031e05de5d', 'request_id': 'req-03c99e44-42be-4112-a88f-031a72a09a5f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.309597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf8248e522d49d48c14cd031e05de5d', 'request_id': 'req-03c99e44-42be-4112-a88f-031a72a09a5f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.316306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf8248e522d49d48c14cd031e05de5d', 'request_id': 'req-03c99e44-42be-4112-a88f-031a72a09a5f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.384573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 979/1963] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:30 2022] POST /identity/v3/users => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:30.389095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38b4d-067e-490b-8588-115b04668917 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:30.404066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38b4d-067e-490b-8588-115b04668917 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:30.458568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] The token cache is being invalidate because project 3cf8248e522d49d48c14cd031e05de5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:30.459141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.459678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.461251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 985/1964] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:30 2022] DELETE /identity/v3/projects/3cf8248e522d49d48c14cd031e05de5d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:30.464549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:30.464549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.464549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.464549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.464927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:30.465165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.465522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:30.466927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:30.478520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 980/1965] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:30.479990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:30.481654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:30.483697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c99e44-42be-4112-a88f-031a72a09a5f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:30.489057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:30.489750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.490128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.490459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] PATH_INFO: `/v3/users/83193ed789f9498c9634b3ef2c145493` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.491744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83193ed789f9498c9634b3ef2c145493)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:30.493704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.494375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb679c-50e6-4215-b25d-66b94f9cbb25 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:30.499579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525c80-858d-4b83-9361-8a6c806bd636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:30.500164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525c80-858d-4b83-9361-8a6c806bd636 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.500448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525c80-858d-4b83-9361-8a6c806bd636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.500716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525c80-858d-4b83-9361-8a6c806bd636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.501349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3525c80-858d-4b83-9361-8a6c806bd636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:30.502986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3525c80-858d-4b83-9361-8a6c806bd636 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.513637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 981/1966] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:30.517440 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525c80-858d-4b83-9361-8a6c806bd636 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:30.527024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525c80-858d-4b83-9361-8a6c806bd636 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:30.531742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:30.532384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.533293 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.533499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] PATH_INFO: `/v3/projects/6af2fdaab6da4cada56282002fdaa7fd/users/bbae026bdf43415688722be80b3c4cd9/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.550636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af2fdaab6da4cada56282002fdaa7fd, user_id=bbae026bdf43415688722be80b3c4cd9, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:30.553369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.703920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 982/1967] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:30 2022] PUT /identity/v3/projects/6af2fdaab6da4cada56282002fdaa7fd/users/bbae026bdf43415688722be80b3c4cd9/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:30.703920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:30.703920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:30.750760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83193ed789f9498c9634b3ef2c145493'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.757867 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83193ed789f9498c9634b3ef2c145493'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.781776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeba859-adc5-4540-aac3-caca3a42bcff admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:30.787252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:30.787891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.788171 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.788457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] PATH_INFO: `/v3/projects/203701944a054af387bd0a761279dcd7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.789609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] RBAC: Authorizing `identity:delete_project(project_id=203701944a054af387bd0a761279dcd7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:30.791573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:30.826407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83193ed789f9498c9634b3ef2c145493'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.827579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83193ed789f9498c9634b3ef2c145493'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.842381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-db361591-ccd0-4e21-a579-a441f10e6152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83193ed789f9498c9634b3ef2c145493'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.849696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 986/1968] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:30 2022] DELETE /identity/v3/users/83193ed789f9498c9634b3ef2c145493 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:30.854039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c31a1-5ade-4e7d-bc62-a26995d73453 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:30.854349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c31a1-5ade-4e7d-bc62-a26995d73453 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:30.854653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c31a1-5ade-4e7d-bc62-a26995d73453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:30.884426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4e5c31a1-5ade-4e7d-bc62-a26995d73453 None None] MFA Rules not processed for user `bbae026bdf43415688722be80b3c4cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:30.885654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4e5c31a1-5ade-4e7d-bc62-a26995d73453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:30.915364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203701944a054af387bd0a761279dcd7', 'request_id': 'req-0d30516b-faa0-4329-b1cd-e077ec8f328d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:30.965714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 987/1969] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:31.003411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203701944a054af387bd0a761279dcd7', 'request_id': 'req-0d30516b-faa0-4329-b1cd-e077ec8f328d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.004544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c31a1-5ade-4e7d-bc62-a26995d73453 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:31.006452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4e5c31a1-5ade-4e7d-bc62-a26995d73453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.010768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203701944a054af387bd0a761279dcd7', 'request_id': 'req-0d30516b-faa0-4329-b1cd-e077ec8f328d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.024837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] The token cache is being invalidate because project 203701944a054af387bd0a761279dcd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:31.025130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.025809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.027604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 983/1970] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:30 2022] DELETE /identity/v3/projects/203701944a054af387bd0a761279dcd7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:31.031309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:31.032663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.097883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c31a1-5ade-4e7d-bc62-a26995d73453 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:31.139496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30516b-faa0-4329-b1cd-e077ec8f328d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:31.159891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:31.160289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:31.160682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:31.161081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] PATH_INFO: `/v3/users/e405f1a1928b43878594fa5a7e17dc8b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:31.162498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e405f1a1928b43878594fa5a7e17dc8b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:31.165016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:31.171814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:31.172569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:31.172808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:31.173108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:31.175524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.238599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:31.240045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:31.250233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 988/1971] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:31.266368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:31.268192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.283452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57039e-b1aa-4b30-9706-033fae5026c9 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:31.293488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:31.294131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:31.294412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:31.294736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] PATH_INFO: `/v3/users/bbae026bdf43415688722be80b3c4cd9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:31.295915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbae026bdf43415688722be80b3c4cd9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:31.297919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:31.347705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:31.357838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e405f1a1928b43878594fa5a7e17dc8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.431808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e405f1a1928b43878594fa5a7e17dc8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.432440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:31.440804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e405f1a1928b43878594fa5a7e17dc8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.453775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e405f1a1928b43878594fa5a7e17dc8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.454566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e405f1a1928b43878594fa5a7e17dc8b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.460650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 984/1972] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:31 2022] DELETE /identity/v3/users/e405f1a1928b43878594fa5a7e17dc8b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:31.461507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:31.462874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.516164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbae026bdf43415688722be80b3c4cd9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.527700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbae026bdf43415688722be80b3c4cd9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.559445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f3147-baf5-4751-afef-0db428bfde7f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:31.564336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:31.565033 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:31.565382 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:31.565757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] PATH_INFO: `/v3/projects/d9df686c21b34eef95823f3b4c1d6c21` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:31.567080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9df686c21b34eef95823f3b4c1d6c21)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:31.569008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:31.603969 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbae026bdf43415688722be80b3c4cd9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.604885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbae026bdf43415688722be80b3c4cd9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.617824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-dfcedf30-f3a9-42f6-a46f-2df4bbf65c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbae026bdf43415688722be80b3c4cd9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.624141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 989/1973] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:31 2022] DELETE /identity/v3/users/bbae026bdf43415688722be80b3c4cd9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:31.628193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691070a-77db-4e00-a241-50ae7e17fc0e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:31.628484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691070a-77db-4e00-a241-50ae7e17fc0e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:31.628764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691070a-77db-4e00-a241-50ae7e17fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:31.648810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b691070a-77db-4e00-a241-50ae7e17fc0e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:31.650027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b691070a-77db-4e00-a241-50ae7e17fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.713385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9df686c21b34eef95823f3b4c1d6c21', 'request_id': 'req-741ec87f-4484-4ab1-827d-8cb1f5350203'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.724022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 990/1974] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:31.733744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691070a-77db-4e00-a241-50ae7e17fc0e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:31.735160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b691070a-77db-4e00-a241-50ae7e17fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.784186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:31.802069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691070a-77db-4e00-a241-50ae7e17fc0e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:31.827071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9df686c21b34eef95823f3b4c1d6c21', 'request_id': 'req-741ec87f-4484-4ab1-827d-8cb1f5350203'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.835389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9df686c21b34eef95823f3b4c1d6c21', 'request_id': 'req-741ec87f-4484-4ab1-827d-8cb1f5350203'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.852431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] The token cache is being invalidate because project d9df686c21b34eef95823f3b4c1d6c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:31.852929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.854767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-741ec87f-4484-4ab1-827d-8cb1f5350203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:31.857025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 985/1975] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:31 2022] DELETE /identity/v3/projects/d9df686c21b34eef95823f3b4c1d6c21 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:31.861814 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c729-376d-4d9d-b1e9-fe0209fe24a8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:31.862283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c729-376d-4d9d-b1e9-fe0209fe24a8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:31.862625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c729-376d-4d9d-b1e9-fe0209fe24a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:31.879380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:31.880062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:31.880353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:31.880635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:31.883492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.907885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-92d0c729-376d-4d9d-b1e9-fe0209fe24a8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:31.912311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-92d0c729-376d-4d9d-b1e9-fe0209fe24a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:31.976236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:31.977683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.008294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 991/1976] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:32.009119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.010426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:32.025067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:32.051194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a9b9-4d64-4725-b0f0-1c7de83a9461 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.060778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.061438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.061790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.062072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] PATH_INFO: `/v3/projects/3ce821f41d9a40119a8bba040d1d2a2c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.069549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce821f41d9a40119a8bba040d1d2a2c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.069549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.072434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 986/1977] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:32.076986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bf796-3058-4a66-8f55-eb67bbd4753f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.076986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bf796-3058-4a66-8f55-eb67bbd4753f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.076986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bf796-3058-4a66-8f55-eb67bbd4753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.125797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fa8bf796-3058-4a66-8f55-eb67bbd4753f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:32.127156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fa8bf796-3058-4a66-8f55-eb67bbd4753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:32.150993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 987/1978] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:32.153143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bf796-3058-4a66-8f55-eb67bbd4753f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.168841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bf796-3058-4a66-8f55-eb67bbd4753f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.175331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.176002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.176941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.176941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.177148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:32.177501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.180209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.208286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 988/1979] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:32.209374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.224412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d33b4-c9bd-4aa4-b4aa-3755c17d84ea admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.242736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce821f41d9a40119a8bba040d1d2a2c', 'request_id': 'req-7dfdfccb-61bb-4700-858e-7194e6f0b129'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:32.251335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce821f41d9a40119a8bba040d1d2a2c', 'request_id': 'req-7dfdfccb-61bb-4700-858e-7194e6f0b129'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:32.258395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce821f41d9a40119a8bba040d1d2a2c', 'request_id': 'req-7dfdfccb-61bb-4700-858e-7194e6f0b129'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:32.315022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.315636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.315916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.316188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.316896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.318778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.339762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] The token cache is being invalidate because project 3ce821f41d9a40119a8bba040d1d2a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:32.342642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:32.342642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7dfdfccb-61bb-4700-858e-7194e6f0b129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:32.343388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 992/1980] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:32 2022] DELETE /identity/v3/projects/3ce821f41d9a40119a8bba040d1d2a2c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:32.349638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503ea8-6ff2-42c9-8c3a-54073d1f2031 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.350095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503ea8-6ff2-42c9-8c3a-54073d1f2031 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.350562 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d503ea8-6ff2-42c9-8c3a-54073d1f2031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.363289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:32.371835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1d503ea8-6ff2-42c9-8c3a-54073d1f2031 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:32.373074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1d503ea8-6ff2-42c9-8c3a-54073d1f2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:32.389496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 993/1981] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:32.397957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73d9e6-e5f1-4f6a-bd55-e607de483501 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.398250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73d9e6-e5f1-4f6a-bd55-e607de483501 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.398623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73d9e6-e5f1-4f6a-bd55-e607de483501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.420860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1e73d9e6-e5f1-4f6a-bd55-e607de483501 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:32.422172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1e73d9e6-e5f1-4f6a-bd55-e607de483501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:32.450108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 994/1982] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:32.453194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73d9e6-e5f1-4f6a-bd55-e607de483501 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.455938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 989/1983] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:32 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:32.458214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.465186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:32.468923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73d9e6-e5f1-4f6a-bd55-e607de483501 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.545189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.545835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.546003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.546516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.547213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:32.547519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.549744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.565389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 995/1984] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:32.567901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26415e1-249e-4725-a790-eafc6fd32e32 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.571120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.574407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.575193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.575543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.575886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.576592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.578892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.584098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610ebd2-4bc2-47bd-aa2d-b0163f35a719 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.589081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c4e56-faa4-4fac-88da-b56ae231470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.589919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c4e56-faa4-4fac-88da-b56ae231470f admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.590194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c4e56-faa4-4fac-88da-b56ae231470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.590494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c4e56-faa4-4fac-88da-b56ae231470f admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.591116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c4e56-faa4-4fac-88da-b56ae231470f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.593515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c4e56-faa4-4fac-88da-b56ae231470f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.715362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 990/1985] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:32 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:32.716368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.718233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:32.731003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b356653-2ff7-4749-9748-68dfd104585c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.744803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 996/1986] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:32 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:32.750082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c4e56-faa4-4fac-88da-b56ae231470f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.751525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.752572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.752853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.753176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] PATH_INFO: `/v3/projects/6af2fdaab6da4cada56282002fdaa7fd` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.754299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af2fdaab6da4cada56282002fdaa7fd)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.756806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.813879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c4e56-faa4-4fac-88da-b56ae231470f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.818629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d699d6-c93e-45c7-8ec5-e4a390114cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.819235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d699d6-c93e-45c7-8ec5-e4a390114cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.819508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d699d6-c93e-45c7-8ec5-e4a390114cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.819777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d699d6-c93e-45c7-8ec5-e4a390114cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.820417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d699d6-c93e-45c7-8ec5-e4a390114cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.821992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d699d6-c93e-45c7-8ec5-e4a390114cfb admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.831792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 997/1987] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:32.832554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d699d6-c93e-45c7-8ec5-e4a390114cfb admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:32.842123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d699d6-c93e-45c7-8ec5-e4a390114cfb admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:32.847331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a345b4-a7a8-4301-968f-acdb013fb588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:32.847889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a345b4-a7a8-4301-968f-acdb013fb588 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:32.848166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a345b4-a7a8-4301-968f-acdb013fb588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:32.848533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a345b4-a7a8-4301-968f-acdb013fb588 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:32.849136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a345b4-a7a8-4301-968f-acdb013fb588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:32.851032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a345b4-a7a8-4301-968f-acdb013fb588 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:32.883455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af2fdaab6da4cada56282002fdaa7fd', 'request_id': 'req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:32.986895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:33.042909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af2fdaab6da4cada56282002fdaa7fd', 'request_id': 'req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:33.052036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 998/1988] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:32 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:33.055409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a345b4-a7a8-4301-968f-acdb013fb588 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.055867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af2fdaab6da4cada56282002fdaa7fd', 'request_id': 'req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:33.066338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a345b4-a7a8-4301-968f-acdb013fb588 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.071732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] The token cache is being invalidate because project 6af2fdaab6da4cada56282002fdaa7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:33.072095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:33.073609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:33.081213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 991/1989] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:32 2022] DELETE /identity/v3/projects/6af2fdaab6da4cada56282002fdaa7fd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:33.081213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.083531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:33.085062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:33.134564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743aeef-92a0-4ac1-8505-0a4fa386c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.135080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743aeef-92a0-4ac1-8505-0a4fa386c140 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.135491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743aeef-92a0-4ac1-8505-0a4fa386c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.135767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743aeef-92a0-4ac1-8505-0a4fa386c140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.136446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743aeef-92a0-4ac1-8505-0a4fa386c140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.138060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743aeef-92a0-4ac1-8505-0a4fa386c140 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.152261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 999/1990] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:33.153554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749a82b-2a64-4ac6-933a-e94c3940d6a2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.153849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749a82b-2a64-4ac6-933a-e94c3940d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.154126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749a82b-2a64-4ac6-933a-e94c3940d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.156434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079fd76-d1eb-4ff5-8472-bd8bffa7228c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.161906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.162531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.162841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.163098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.163740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.165320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.174720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-e749a82b-2a64-4ac6-933a-e94c3940d6a2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:33.175306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 992/1991] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:33.176087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.177644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:33.178834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e749a82b-2a64-4ac6-933a-e94c3940d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:33.187713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1000/1992] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:33.194328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749a82b-2a64-4ac6-933a-e94c3940d6a2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.196688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840a514-821c-4f61-b106-7e428f5b174f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.201734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f35e-e6df-4fae-9d94-f633789c98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.202006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749a82b-2a64-4ac6-933a-e94c3940d6a2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.202532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f35e-e6df-4fae-9d94-f633789c98f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.202815 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f35e-e6df-4fae-9d94-f633789c98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.203091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f35e-e6df-4fae-9d94-f633789c98f4 admin admin] PATH_INFO: `/v3/projects/fb0f4629bd0548459136b3ddfb7d7997/users/44014a6ea3784c00a8f9f1e7806408fe/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.207201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c5663-0420-4de9-823c-7b264ec1705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.207902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5663-0420-4de9-823c-7b264ec1705d admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.208218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5663-0420-4de9-823c-7b264ec1705d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.208489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5663-0420-4de9-823c-7b264ec1705d admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.209130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c5663-0420-4de9-823c-7b264ec1705d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.210740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c5663-0420-4de9-823c-7b264ec1705d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.221940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1001/1993] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:33.223414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516deb92-baf1-4537-aeb5-a239c5ed9776 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.223701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516deb92-baf1-4537-aeb5-a239c5ed9776 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.223973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516deb92-baf1-4537-aeb5-a239c5ed9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.224935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f35e-e6df-4fae-9d94-f633789c98f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0f4629bd0548459136b3ddfb7d7997, user_id=44014a6ea3784c00a8f9f1e7806408fe, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.227682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f35e-e6df-4fae-9d94-f633789c98f4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.243803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-516deb92-baf1-4537-aeb5-a239c5ed9776 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:33.244997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-516deb92-baf1-4537-aeb5-a239c5ed9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:33.253059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1002/1994] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:33.255367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516deb92-baf1-4537-aeb5-a239c5ed9776 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.265775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516deb92-baf1-4537-aeb5-a239c5ed9776 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.271162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d21ac-8ed6-4e33-84dc-81814a76e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.271845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d21ac-8ed6-4e33-84dc-81814a76e033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.272114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d21ac-8ed6-4e33-84dc-81814a76e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.272385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d21ac-8ed6-4e33-84dc-81814a76e033 admin admin] PATH_INFO: `/v3/projects/561ec673e2964d14b94ebc9c9f7f290e/users/2b9009d3013f4607bf0ffcf93c27c58f/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.288695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d21ac-8ed6-4e33-84dc-81814a76e033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561ec673e2964d14b94ebc9c9f7f290e, user_id=2b9009d3013f4607bf0ffcf93c27c58f, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.291375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d21ac-8ed6-4e33-84dc-81814a76e033 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.347606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 993/1995] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:33 2022] PUT /identity/v3/projects/fb0f4629bd0548459136b3ddfb7d7997/users/44014a6ea3784c00a8f9f1e7806408fe/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:33.358494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f35e-e6df-4fae-9d94-f633789c98f4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.387427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1003/1996] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:33 2022] PUT /identity/v3/projects/561ec673e2964d14b94ebc9c9f7f290e/users/2b9009d3013f4607bf0ffcf93c27c58f/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:33.399311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10897-e95c-4795-a11c-286f3dd77a40 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.399593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10897-e95c-4795-a11c-286f3dd77a40 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.399863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10897-e95c-4795-a11c-286f3dd77a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.419792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f35e-e6df-4fae-9d94-f633789c98f4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.429277 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-23a10897-e95c-4795-a11c-286f3dd77a40 None None] MFA Rules not processed for user `44014a6ea3784c00a8f9f1e7806408fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:33.430514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-23a10897-e95c-4795-a11c-286f3dd77a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:33.478267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69499d89-50e3-43bb-a05c-b296f3bcd0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.478909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499d89-50e3-43bb-a05c-b296f3bcd0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.479193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499d89-50e3-43bb-a05c-b296f3bcd0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.479457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499d89-50e3-43bb-a05c-b296f3bcd0fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.480226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69499d89-50e3-43bb-a05c-b296f3bcd0fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:33.480542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69499d89-50e3-43bb-a05c-b296f3bcd0fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.482242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69499d89-50e3-43bb-a05c-b296f3bcd0fc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.498404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 994/1997] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:33.499967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e099f1-4855-4cdb-a569-3b67302ce7e0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.500352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e099f1-4855-4cdb-a569-3b67302ce7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.500650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e099f1-4855-4cdb-a569-3b67302ce7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.507152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1004/1998] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:33.507152 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a10897-e95c-4795-a11c-286f3dd77a40 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.518942 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a10897-e95c-4795-a11c-286f3dd77a40 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.523778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa4e67-a00b-4fe2-89e3-b33761b7165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.524490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4e67-a00b-4fe2-89e3-b33761b7165e admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.524882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4e67-a00b-4fe2-89e3-b33761b7165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.525246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4e67-a00b-4fe2-89e3-b33761b7165e admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.525963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa4e67-a00b-4fe2-89e3-b33761b7165e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.528003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa4e67-a00b-4fe2-89e3-b33761b7165e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.536960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b0e099f1-4855-4cdb-a569-3b67302ce7e0 None None] MFA Rules not processed for user `2b9009d3013f4607bf0ffcf93c27c58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:33.538159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b0e099f1-4855-4cdb-a569-3b67302ce7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:33.607030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 995/1999] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:33.607030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e099f1-4855-4cdb-a569-3b67302ce7e0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.615408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e099f1-4855-4cdb-a569-3b67302ce7e0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.621067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d432a6-ce2a-4de8-89f4-16c3f89f6609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.621677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d432a6-ce2a-4de8-89f4-16c3f89f6609 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.621952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d432a6-ce2a-4de8-89f4-16c3f89f6609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.622220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d432a6-ce2a-4de8-89f4-16c3f89f6609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.622965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d432a6-ce2a-4de8-89f4-16c3f89f6609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.624811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d432a6-ce2a-4de8-89f4-16c3f89f6609 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.630566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1005/2000] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:33.630566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa4e67-a00b-4fe2-89e3-b33761b7165e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.691913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa4e67-a00b-4fe2-89e3-b33761b7165e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.696621 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cfbf6-eee1-44e3-b93e-945fe48e8296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.697223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfbf6-eee1-44e3-b93e-945fe48e8296 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.697498 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfbf6-eee1-44e3-b93e-945fe48e8296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.697766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfbf6-eee1-44e3-b93e-945fe48e8296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.698383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cfbf6-eee1-44e3-b93e-945fe48e8296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.700314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cfbf6-eee1-44e3-b93e-945fe48e8296 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.749246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 996/2001] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:33.750064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d432a6-ce2a-4de8-89f4-16c3f89f6609 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.820401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d432a6-ce2a-4de8-89f4-16c3f89f6609 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.825428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.826747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.827024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.827295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.827918 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.829992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.852000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1006/2002] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:33.852500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cfbf6-eee1-44e3-b93e-945fe48e8296 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.916784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 997/2003] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:33.916784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:33.916784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:33.920310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cfbf6-eee1-44e3-b93e-945fe48e8296 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.933179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43edad-cb5e-4d09-939d-dff4c525b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.933971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43edad-cb5e-4d09-939d-dff4c525b924 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.934314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413a79-0332-4bdc-9a86-1809e7ea41f3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:33.934584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43edad-cb5e-4d09-939d-dff4c525b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.934958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43edad-cb5e-4d09-939d-dff4c525b924 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.936758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43edad-cb5e-4d09-939d-dff4c525b924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.941046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43edad-cb5e-4d09-939d-dff4c525b924 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:33.943172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:33.943991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:33.946677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:33.947047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] PATH_INFO: `/v3/users/b86d11f77f7a459dbaa8e86bb469301a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:33.948416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86d11f77f7a459dbaa8e86bb469301a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:33.950688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.049569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1007/2004] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:33 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:34.053763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43edad-cb5e-4d09-939d-dff4c525b924 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.064773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43edad-cb5e-4d09-939d-dff4c525b924 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.069782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636aca0-19da-477f-88bb-66155c8b0e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.070542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636aca0-19da-477f-88bb-66155c8b0e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.070919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636aca0-19da-477f-88bb-66155c8b0e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.071290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636aca0-19da-477f-88bb-66155c8b0e4e admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.072008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636aca0-19da-477f-88bb-66155c8b0e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.074164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636aca0-19da-477f-88bb-66155c8b0e4e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.188697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1008/2005] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:34 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:34.189970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636aca0-19da-477f-88bb-66155c8b0e4e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.199198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:34.204566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86d11f77f7a459dbaa8e86bb469301a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:34.206671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636aca0-19da-477f-88bb-66155c8b0e4e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.214425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccf88d-90d5-410b-af86-3d1a3c962697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.215197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccf88d-90d5-410b-af86-3d1a3c962697 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.215539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccf88d-90d5-410b-af86-3d1a3c962697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.215905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccf88d-90d5-410b-af86-3d1a3c962697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.216740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccf88d-90d5-410b-af86-3d1a3c962697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.218616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccf88d-90d5-410b-af86-3d1a3c962697 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.232524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1009/2006] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:34.233392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccf88d-90d5-410b-af86-3d1a3c962697 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.247822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccf88d-90d5-410b-af86-3d1a3c962697 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.253242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a0471-e430-4cff-a29d-3633043c1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.253852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a0471-e430-4cff-a29d-3633043c1ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.254177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a0471-e430-4cff-a29d-3633043c1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.254394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a0471-e430-4cff-a29d-3633043c1ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.255073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a0471-e430-4cff-a29d-3633043c1ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.257570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a0471-e430-4cff-a29d-3633043c1ba6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.267776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1010/2007] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:34.270177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a0471-e430-4cff-a29d-3633043c1ba6 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.281634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a0471-e430-4cff-a29d-3633043c1ba6 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.287605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58154091-f019-44b7-abea-69b99791e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.288405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58154091-f019-44b7-abea-69b99791e67b admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.288780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58154091-f019-44b7-abea-69b99791e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.289147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58154091-f019-44b7-abea-69b99791e67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.289888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58154091-f019-44b7-abea-69b99791e67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.291147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86d11f77f7a459dbaa8e86bb469301a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:34.291944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58154091-f019-44b7-abea-69b99791e67b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.306212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86d11f77f7a459dbaa8e86bb469301a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:34.312084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1011/2008] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:34.317460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58154091-f019-44b7-abea-69b99791e67b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.334154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58154091-f019-44b7-abea-69b99791e67b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.334726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86d11f77f7a459dbaa8e86bb469301a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:34.336007 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86d11f77f7a459dbaa8e86bb469301a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:34.340917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:34.343401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.344111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.344442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.344771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.345994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.347954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 998/2009] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:33 2022] DELETE /identity/v3/users/b86d11f77f7a459dbaa8e86bb469301a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:34.348093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.348877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.351262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:34.360756 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1012/2010] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:34.362388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.364379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:34.378746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05eef2-e9df-48b7-91dd-12996dcee4cd admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.440819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dc094-b360-4e2f-9bba-c38886b5bee9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.446064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cfd62-0da6-49e4-a3a0-88aae5359dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.447008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfd62-0da6-49e4-a3a0-88aae5359dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.447430 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfd62-0da6-49e4-a3a0-88aae5359dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.450631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cfd62-0da6-49e4-a3a0-88aae5359dc9 admin admin] PATH_INFO: `/v3/projects/9efd53caf9864dc7a4822c0a18d1c688/users/471ea2e0aabd446c87bf83222b210bda/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.458601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.459215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.459489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.459766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] PATH_INFO: `/v3/projects/5c9f7f492d8f40198994c39c3e532e0b/users/f76bdff3214f44b98d9aa2273ae5c2b4/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.466379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cfd62-0da6-49e4-a3a0-88aae5359dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efd53caf9864dc7a4822c0a18d1c688, user_id=471ea2e0aabd446c87bf83222b210bda, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.471104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cfd62-0da6-49e4-a3a0-88aae5359dc9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.475224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9f7f492d8f40198994c39c3e532e0b, user_id=f76bdff3214f44b98d9aa2273ae5c2b4, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.478922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.573473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 999/2011] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:34 2022] PUT /identity/v3/projects/9efd53caf9864dc7a4822c0a18d1c688/users/471ea2e0aabd446c87bf83222b210bda/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:34.574436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1013/2012] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:34 2022] PUT /identity/v3/projects/5c9f7f492d8f40198994c39c3e532e0b/users/f76bdff3214f44b98d9aa2273ae5c2b4/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:34.574777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6e6c-8444-45e5-9f90-18d24584dcad None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.576525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6e6c-8444-45e5-9f90-18d24584dcad None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.576525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6e6c-8444-45e5-9f90-18d24584dcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.576679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.577923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:34.594775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ff4b6e6c-8444-45e5-9f90-18d24584dcad None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:34.596652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ff4b6e6c-8444-45e5-9f90-18d24584dcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:34.641128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23680330-cc0f-4445-80c1-abd1ac38e085 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.653095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1000/2013] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:34.653812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6e6c-8444-45e5-9f90-18d24584dcad None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.664792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6e6c-8444-45e5-9f90-18d24584dcad None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.670143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fde043-4e48-4d49-8433-bac106b3fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.670911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fde043-4e48-4d49-8433-bac106b3fbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.671189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fde043-4e48-4d49-8433-bac106b3fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.671567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fde043-4e48-4d49-8433-bac106b3fbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.672338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fde043-4e48-4d49-8433-bac106b3fbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.674593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fde043-4e48-4d49-8433-bac106b3fbc0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.692385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1001/2014] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:34.692385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fde043-4e48-4d49-8433-bac106b3fbc0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.700914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fde043-4e48-4d49-8433-bac106b3fbc0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.704779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd333-a9bc-4d09-b066-84e6884ca998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.705530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd333-a9bc-4d09-b066-84e6884ca998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.705823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd333-a9bc-4d09-b066-84e6884ca998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.705970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.706104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd333-a9bc-4d09-b066-84e6884ca998 admin admin] PATH_INFO: `/v3/projects/ca3946b4be044dc892d608672069c366/users/827e8de6dbf84bdd809a359b5bf5a6cf/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.706824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.707167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.707640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.708470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.710144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.721094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1002/2015] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:34.721262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cd333-a9bc-4d09-b066-84e6884ca998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3946b4be044dc892d608672069c366, user_id=827e8de6dbf84bdd809a359b5bf5a6cf, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.724096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cd333-a9bc-4d09-b066-84e6884ca998 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.725737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.726656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:34.745362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:34.793342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1240e-cd4b-49f0-9d15-ad5fe102cd9a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.797177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e0dbe-6427-4c19-8e83-eb52bbe7c810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:34.797864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0dbe-6427-4c19-8e83-eb52bbe7c810 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:34.798140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0dbe-6427-4c19-8e83-eb52bbe7c810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:34.799035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0dbe-6427-4c19-8e83-eb52bbe7c810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:34.806453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1014/2016] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:34 2022] PUT /identity/v3/projects/ca3946b4be044dc892d608672069c366/users/827e8de6dbf84bdd809a359b5bf5a6cf/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:34.807623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd333-a9bc-4d09-b066-84e6884ca998 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.809444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e0dbe-6427-4c19-8e83-eb52bbe7c810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:34.810942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e0dbe-6427-4c19-8e83-eb52bbe7c810 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:34.821950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1003/2017] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:34.822656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e0dbe-6427-4c19-8e83-eb52bbe7c810 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:34.844288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e0dbe-6427-4c19-8e83-eb52bbe7c810 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:34.904052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd333-a9bc-4d09-b066-84e6884ca998 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:35.055826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f51a94-4d44-434e-b698-1e9779e87a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:35.055826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f51a94-4d44-434e-b698-1e9779e87a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:35.055826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f51a94-4d44-434e-b698-1e9779e87a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:35.055826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f51a94-4d44-434e-b698-1e9779e87a88 admin admin] PATH_INFO: `/v3/projects/9efd53caf9864dc7a4822c0a18d1c688/users/471ea2e0aabd446c87bf83222b210bda/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:35.056466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f51a94-4d44-434e-b698-1e9779e87a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efd53caf9864dc7a4822c0a18d1c688, user_id=471ea2e0aabd446c87bf83222b210bda, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:35.056466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f51a94-4d44-434e-b698-1e9779e87a88 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:35.056466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1015/2018] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:34 2022] PUT /identity/v3/projects/9efd53caf9864dc7a4822c0a18d1c688/users/471ea2e0aabd446c87bf83222b210bda/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:35.056466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f059-bb31-42b5-b5b2-4a70c53cbec2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:35.056466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f059-bb31-42b5-b5b2-4a70c53cbec2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:35.056466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f059-bb31-42b5-b5b2-4a70c53cbec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:35.056993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb0968-1881-4eaa-9fcc-47e361a2d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:35.056993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb0968-1881-4eaa-9fcc-47e361a2d98c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:35.056993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb0968-1881-4eaa-9fcc-47e361a2d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:35.056993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb0968-1881-4eaa-9fcc-47e361a2d98c admin admin] PATH_INFO: `/v3/projects/5c9f7f492d8f40198994c39c3e532e0b/users/f76bdff3214f44b98d9aa2273ae5c2b4/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:35.057302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb0968-1881-4eaa-9fcc-47e361a2d98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9f7f492d8f40198994c39c3e532e0b, user_id=f76bdff3214f44b98d9aa2273ae5c2b4, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:35.057302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb0968-1881-4eaa-9fcc-47e361a2d98c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:35.057446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-2929f059-bb31-42b5-b5b2-4a70c53cbec2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:35.057446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2929f059-bb31-42b5-b5b2-4a70c53cbec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:35.057594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1004/2019] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:34 2022] PUT /identity/v3/projects/5c9f7f492d8f40198994c39c3e532e0b/users/f76bdff3214f44b98d9aa2273ae5c2b4/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:35.057594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40d19-a408-46d2-950b-4015456f7805 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:35.057594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40d19-a408-46d2-950b-4015456f7805 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:35.057594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40d19-a408-46d2-950b-4015456f7805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:35.057834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1016/2020] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:35.057834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971c5d-347e-47ed-9427-1e03e9fc07b3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:35.057834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971c5d-347e-47ed-9427-1e03e9fc07b3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:35.057834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971c5d-347e-47ed-9427-1e03e9fc07b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:35.076047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-66b40d19-a408-46d2-950b-4015456f7805 None None] MFA Rules not processed for user `f76bdff3214f44b98d9aa2273ae5c2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:35.077370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-66b40d19-a408-46d2-950b-4015456f7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:35.087030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-c4971c5d-347e-47ed-9427-1e03e9fc07b3 None None] MFA Rules not processed for user `471ea2e0aabd446c87bf83222b210bda`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:35.088536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c4971c5d-347e-47ed-9427-1e03e9fc07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:35.152684 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1005/2021] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:35.153431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40d19-a408-46d2-950b-4015456f7805 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:35.189309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1017/2022] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:35.190920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971c5d-347e-47ed-9427-1e03e9fc07b3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:35.192771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c4971c5d-347e-47ed-9427-1e03e9fc07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:35.227787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40d19-a408-46d2-950b-4015456f7805 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:35.231773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:35.232423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:35.232698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:35.232970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:35.245677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:35.247636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:35.254967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971c5d-347e-47ed-9427-1e03e9fc07b3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:35.257763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1006/2023] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:35.258848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:35.259467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:35.259750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:35.259958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:35.260069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:35.261802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:35.261949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:35.279849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc6c6-3a1c-4a74-81f6-ea4c7b52d409 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:35.286745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdd308-7e45-4fa0-a6e6-71f4806606b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:35.501393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd308-7e45-4fa0-a6e6-71f4806606b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:35.501393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd308-7e45-4fa0-a6e6-71f4806606b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:35.501393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd308-7e45-4fa0-a6e6-71f4806606b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:35.501393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdd308-7e45-4fa0-a6e6-71f4806606b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:35.501393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdd308-7e45-4fa0-a6e6-71f4806606b3 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:35.501393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1007/2024] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:35.503349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:35.503349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:35.503349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1018/2025] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:36.226943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:36.557719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdd308-7e45-4fa0-a6e6-71f4806606b3 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:36.572733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdd308-7e45-4fa0-a6e6-71f4806606b3 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:36.589639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:36.591909 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:36.608083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:36.610406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:36.611910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:36.612768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] PATH_INFO: `/v3/users/44014a6ea3784c00a8f9f1e7806408fe` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:36.615883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44014a6ea3784c00a8f9f1e7806408fe)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:36.617963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f030e-abe1-493a-88af-24dd69737d6c service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:36.620581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:36.630625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:36.632536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:36.634589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:36.635108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] PATH_INFO: `/v3/projects/784c937dbfdc48edbe5f4cb48ad24fd2` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:36.639404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784c937dbfdc48edbe5f4cb48ad24fd2)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:36.645012 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:36.867224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784c937dbfdc48edbe5f4cb48ad24fd2', 'request_id': 'req-105cda8d-af0b-4cd5-af84-b3e15b229668'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.871909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44014a6ea3784c00a8f9f1e7806408fe'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.874172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784c937dbfdc48edbe5f4cb48ad24fd2', 'request_id': 'req-105cda8d-af0b-4cd5-af84-b3e15b229668'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.882679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784c937dbfdc48edbe5f4cb48ad24fd2', 'request_id': 'req-105cda8d-af0b-4cd5-af84-b3e15b229668'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.917075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44014a6ea3784c00a8f9f1e7806408fe'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.927079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44014a6ea3784c00a8f9f1e7806408fe'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.942522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44014a6ea3784c00a8f9f1e7806408fe'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.942522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7cd2d391-af29-42ec-a896-5bf8470fdf12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44014a6ea3784c00a8f9f1e7806408fe'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.948354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1008/2026] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:36 2022] DELETE /identity/v3/users/44014a6ea3784c00a8f9f1e7806408fe => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:36.952754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00334c-6fad-44ee-8971-985d3953c3dd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:36.953073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00334c-6fad-44ee-8971-985d3953c3dd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:36.953698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00334c-6fad-44ee-8971-985d3953c3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:36.957840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:36.978849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-db00334c-6fad-44ee-8971-985d3953c3dd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:36.980072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db00334c-6fad-44ee-8971-985d3953c3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:36.991194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] The token cache is being invalidate because project 784c937dbfdc48edbe5f4cb48ad24fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:36.991483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.993698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-105cda8d-af0b-4cd5-af84-b3e15b229668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:36.995701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1019/2027] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:36 2022] DELETE /identity/v3/projects/784c937dbfdc48edbe5f4cb48ad24fd2 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:37.002208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4f49-4ee9-410e-8801-55a93efa44aa None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.002719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4f49-4ee9-410e-8801-55a93efa44aa None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.003286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e4f49-4ee9-410e-8801-55a93efa44aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.039175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-563e4f49-4ee9-410e-8801-55a93efa44aa None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:37.040538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-563e4f49-4ee9-410e-8801-55a93efa44aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:37.062869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1009/2028] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:37.104023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00334c-6fad-44ee-8971-985d3953c3dd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:37.105820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db00334c-6fad-44ee-8971-985d3953c3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:37.110202 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1020/2029] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:37.119095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8a1e3-7468-4a81-a13c-ba838bc77449 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.119467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8a1e3-7468-4a81-a13c-ba838bc77449 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.120245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8a1e3-7468-4a81-a13c-ba838bc77449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.169245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-76a8a1e3-7468-4a81-a13c-ba838bc77449 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:37.171158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-76a8a1e3-7468-4a81-a13c-ba838bc77449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:37.183812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1021/2030] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:37.187936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8a1e3-7468-4a81-a13c-ba838bc77449 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:37.199003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8a1e3-7468-4a81-a13c-ba838bc77449 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:37.201588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00334c-6fad-44ee-8971-985d3953c3dd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:37.205084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:37.206964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d3073-acee-4538-8ea9-67ca35856277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:37.207079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.207079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.207079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.207306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3073-acee-4538-8ea9-67ca35856277 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.207306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3073-acee-4538-8ea9-67ca35856277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.207443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:37.207443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:37.207897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3073-acee-4538-8ea9-67ca35856277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.209212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:37.218767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d3073-acee-4538-8ea9-67ca35856277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:37.221139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d3073-acee-4538-8ea9-67ca35856277 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:37.224840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1022/2031] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:42:37.229850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:37.237934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1010/2032] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:37.242326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4fddf-7a52-46fe-b38b-1cf74f752db7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:37.247343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16c22-40c7-48d6-9ea7-e1df2190beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:37.247972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16c22-40c7-48d6-9ea7-e1df2190beb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.248246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16c22-40c7-48d6-9ea7-e1df2190beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.248519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16c22-40c7-48d6-9ea7-e1df2190beb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.249279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa16c22-40c7-48d6-9ea7-e1df2190beb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:37.251114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa16c22-40c7-48d6-9ea7-e1df2190beb3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:37.380135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1023/2033] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:37 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:37.381729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d3073-acee-4538-8ea9-67ca35856277 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:37.394310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d3073-acee-4538-8ea9-67ca35856277 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:37.508265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108c10-73e2-49cc-bd36-df6d63176f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:37.509321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108c10-73e2-49cc-bd36-df6d63176f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.509461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108c10-73e2-49cc-bd36-df6d63176f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.510538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108c10-73e2-49cc-bd36-df6d63176f56 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.511227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108c10-73e2-49cc-bd36-df6d63176f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:37.515272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108c10-73e2-49cc-bd36-df6d63176f56 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:37.539290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:37.646640 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:37.655777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1011/2034] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:37 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:37.660696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16c22-40c7-48d6-9ea7-e1df2190beb3 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:37.673698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16c22-40c7-48d6-9ea7-e1df2190beb3 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:37.695278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5afbef-4b5c-49f9-9f8f-9cf388dd24f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:37.695948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5afbef-4b5c-49f9-9f8f-9cf388dd24f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.696494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5afbef-4b5c-49f9-9f8f-9cf388dd24f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.696764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5afbef-4b5c-49f9-9f8f-9cf388dd24f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.697775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5afbef-4b5c-49f9-9f8f-9cf388dd24f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:37.699732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5afbef-4b5c-49f9-9f8f-9cf388dd24f3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:37.717154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1024/2035] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:37.718111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108c10-73e2-49cc-bd36-df6d63176f56 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:37.731020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108c10-73e2-49cc-bd36-df6d63176f56 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:37.736177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601eb882-7969-4686-9c2b-0ebd063fe6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:37.736680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eb882-7969-4686-9c2b-0ebd063fe6da admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.736956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eb882-7969-4686-9c2b-0ebd063fe6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.737267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eb882-7969-4686-9c2b-0ebd063fe6da admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.737875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601eb882-7969-4686-9c2b-0ebd063fe6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:37.739768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601eb882-7969-4686-9c2b-0ebd063fe6da admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:37.754509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1012/2036] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:37.758213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5afbef-4b5c-49f9-9f8f-9cf388dd24f3 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:37.773975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5afbef-4b5c-49f9-9f8f-9cf388dd24f3 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:37.780081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612dfed-2cf4-42ad-839a-b1d9bd18754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:37.780898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612dfed-2cf4-42ad-839a-b1d9bd18754a admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.781420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612dfed-2cf4-42ad-839a-b1d9bd18754a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.781764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612dfed-2cf4-42ad-839a-b1d9bd18754a admin admin] PATH_INFO: `/v3/projects/3806f79f5af74ccdb241f71b5bfe47d3/users/af3c2272ed9f4ef6a851ae7ba47a6bdf/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:37.804820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612dfed-2cf4-42ad-839a-b1d9bd18754a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3806f79f5af74ccdb241f71b5bfe47d3, user_id=af3c2272ed9f4ef6a851ae7ba47a6bdf, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:37.804820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612dfed-2cf4-42ad-839a-b1d9bd18754a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:37.956751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1025/2037] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:37 2022] PUT /identity/v3/projects/3806f79f5af74ccdb241f71b5bfe47d3/users/af3c2272ed9f4ef6a851ae7ba47a6bdf/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:37.967213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5611-d4ab-4594-958d-fbafb7497bf7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:37.967514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5611-d4ab-4594-958d-fbafb7497bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:37.967829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5611-d4ab-4594-958d-fbafb7497bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:38.021501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b13f5611-d4ab-4594-958d-fbafb7497bf7 None None] MFA Rules not processed for user `af3c2272ed9f4ef6a851ae7ba47a6bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:38.023305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b13f5611-d4ab-4594-958d-fbafb7497bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:38.115784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1013/2038] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:38.119855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612dfed-2cf4-42ad-839a-b1d9bd18754a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:38.244438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5611-d4ab-4594-958d-fbafb7497bf7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:38.244438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b13f5611-d4ab-4594-958d-fbafb7497bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:38.263275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612dfed-2cf4-42ad-839a-b1d9bd18754a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:38.269002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17ddae-174c-46c7-8ca3-fac7fe2f46de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:38.279342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17ddae-174c-46c7-8ca3-fac7fe2f46de admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:38.279342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17ddae-174c-46c7-8ca3-fac7fe2f46de admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:38.279342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17ddae-174c-46c7-8ca3-fac7fe2f46de admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:38.279342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17ddae-174c-46c7-8ca3-fac7fe2f46de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:38.279342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17ddae-174c-46c7-8ca3-fac7fe2f46de admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:38.374014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1026/2039] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:38 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:38.375601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da8eb-7137-4a74-8ab8-66a5e62c2055 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:38.376037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da8eb-7137-4a74-8ab8-66a5e62c2055 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:38.376853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da8eb-7137-4a74-8ab8-66a5e62c2055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:38.392753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5611-d4ab-4594-958d-fbafb7497bf7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:38.441744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b68da8eb-7137-4a74-8ab8-66a5e62c2055 None None] MFA Rules not processed for user `827e8de6dbf84bdd809a359b5bf5a6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:38.445505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b68da8eb-7137-4a74-8ab8-66a5e62c2055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:38.540667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:38.567811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:38.569133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:38.569133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:38.571869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] PATH_INFO: `/v3/projects/fb0f4629bd0548459136b3ddfb7d7997` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:38.571869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0f4629bd0548459136b3ddfb7d7997)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:38.573110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:38.613540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1027/2040] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:38.614809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68da8eb-7137-4a74-8ab8-66a5e62c2055 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:38.640718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68da8eb-7137-4a74-8ab8-66a5e62c2055 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:38.655397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:38.655397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:38.655397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:38.655397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:38.656269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:38.656269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:38.723993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0f4629bd0548459136b3ddfb7d7997', 'request_id': 'req-d2033b94-89e0-4b20-b0bf-389bf18dff2e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:38.749263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1028/2041] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:38 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:38.749985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:38.752815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:38.817966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943922-1126-4f46-803d-645d20369b88 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:38.846216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0f4629bd0548459136b3ddfb7d7997', 'request_id': 'req-d2033b94-89e0-4b20-b0bf-389bf18dff2e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:38.861024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0f4629bd0548459136b3ddfb7d7997', 'request_id': 'req-d2033b94-89e0-4b20-b0bf-389bf18dff2e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:38.872264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] The token cache is being invalidate because project fb0f4629bd0548459136b3ddfb7d7997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:38.872468 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:38.873705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:38.875439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1014/2042] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:38 2022] DELETE /identity/v3/projects/fb0f4629bd0548459136b3ddfb7d7997 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:38.876762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:38.879574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:38.889043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:38.889699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:38.889971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:38.890247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:38.893126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:38.966371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033b94-89e0-4b20-b0bf-389bf18dff2e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:38.972578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:38.973450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:38.973911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:38.974401 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:38.975106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:38.976773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:38.982974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:38.985259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:38.989609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1015/2043] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:38.993242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:38.996180 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:38.997375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:39.000457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1029/2044] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:39.001752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:39.025869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6e3c-e7e7-49c1-a591-d09e3a039d38 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:39.026024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854824-2f1f-4ccf-9e59-348c871bde8e service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:39.031444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:39.032200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:39.033095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:39.033452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] PATH_INFO: `/v3/users/471ea2e0aabd446c87bf83222b210bda` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:39.035029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=471ea2e0aabd446c87bf83222b210bda)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:39.041108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271b68-ec45-4fdf-a15b-135aea5ac732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:39.041232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:39.041336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271b68-ec45-4fdf-a15b-135aea5ac732 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:39.041336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271b68-ec45-4fdf-a15b-135aea5ac732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:39.041336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271b68-ec45-4fdf-a15b-135aea5ac732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:39.041336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6271b68-ec45-4fdf-a15b-135aea5ac732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:39.041336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6271b68-ec45-4fdf-a15b-135aea5ac732 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:39.053595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1030/2045] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:39.057654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271b68-ec45-4fdf-a15b-135aea5ac732 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:39.068598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271b68-ec45-4fdf-a15b-135aea5ac732 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:39.073727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dd0fa-34a8-4a9f-b9f8-472e1129fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:39.075028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd0fa-34a8-4a9f-b9f8-472e1129fa8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:39.075028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd0fa-34a8-4a9f-b9f8-472e1129fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:39.075313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd0fa-34a8-4a9f-b9f8-472e1129fa8e admin admin] PATH_INFO: `/v3/projects/8577dc05c99c4d5d95a43d654f01d944/users/8e0a1f0344954270bc9774e0e55cf1ec/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:39.091259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dd0fa-34a8-4a9f-b9f8-472e1129fa8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8577dc05c99c4d5d95a43d654f01d944, user_id=8e0a1f0344954270bc9774e0e55cf1ec, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:39.093967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dd0fa-34a8-4a9f-b9f8-472e1129fa8e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:39.243578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1031/2046] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:39 2022] PUT /identity/v3/projects/8577dc05c99c4d5d95a43d654f01d944/users/8e0a1f0344954270bc9774e0e55cf1ec/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:39.254984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ae1c-8025-4bd4-9b32-8fea910e1402 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:39.255336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ae1c-8025-4bd4-9b32-8fea910e1402 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:39.255677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ae1c-8025-4bd4-9b32-8fea910e1402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:39.288668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8589ae1c-8025-4bd4-9b32-8fea910e1402 None None] MFA Rules not processed for user `8e0a1f0344954270bc9774e0e55cf1ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:39.290179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8589ae1c-8025-4bd4-9b32-8fea910e1402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:39.301306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471ea2e0aabd446c87bf83222b210bda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:39.361202 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1032/2047] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:39.365836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589ae1c-8025-4bd4-9b32-8fea910e1402 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:39.380435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471ea2e0aabd446c87bf83222b210bda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:39.401184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471ea2e0aabd446c87bf83222b210bda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:39.423461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471ea2e0aabd446c87bf83222b210bda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:39.424190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471ea2e0aabd446c87bf83222b210bda'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:39.431258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1016/2048] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:38 2022] DELETE /identity/v3/users/471ea2e0aabd446c87bf83222b210bda => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:39.453823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589ae1c-8025-4bd4-9b32-8fea910e1402 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:39.521659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4a7bc-3ae9-46ab-a8f1-0419939a8c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:39.522367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a7bc-3ae9-46ab-a8f1-0419939a8c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:39.522743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a7bc-3ae9-46ab-a8f1-0419939a8c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:39.523357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a7bc-3ae9-46ab-a8f1-0419939a8c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:39.524413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4a7bc-3ae9-46ab-a8f1-0419939a8c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:39.526491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4a7bc-3ae9-46ab-a8f1-0419939a8c46 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:39.670733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1033/2049] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:39 2022] POST /identity/v3/projects => generated 383 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:39.672819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:39.674253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:39.687302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a06a1-c3a3-4581-8c18-5634f8c696aa admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:39.743947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa808067-4a20-44bc-959d-d837c6f1536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:39.744594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa808067-4a20-44bc-959d-d837c6f1536d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:39.744874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa808067-4a20-44bc-959d-d837c6f1536d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:39.745145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa808067-4a20-44bc-959d-d837c6f1536d admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:39.745780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa808067-4a20-44bc-959d-d837c6f1536d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:39.747734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa808067-4a20-44bc-959d-d837c6f1536d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:39.795250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:39.843951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1017/2050] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:39 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:39.848725 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4a7bc-3ae9-46ab-a8f1-0419939a8c46 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:39.859877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4a7bc-3ae9-46ab-a8f1-0419939a8c46 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:39.865827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:39.866424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:39.866765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:39.867035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:39.867674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:39.869258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:39.880524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1034/2051] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:39.884705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa808067-4a20-44bc-959d-d837c6f1536d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:39.894938 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa808067-4a20-44bc-959d-d837c6f1536d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:39.899539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc740766-fd7e-44fb-9ff5-339923fb9ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:39.900175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740766-fd7e-44fb-9ff5-339923fb9ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:39.900449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740766-fd7e-44fb-9ff5-339923fb9ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:39.900718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740766-fd7e-44fb-9ff5-339923fb9ce9 admin admin] PATH_INFO: `/v3/projects/1ab59af651984540b6643f39db7f02c2/users/0b315c1f2933477b80283cdc1c9bb9a9/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:39.916757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc740766-fd7e-44fb-9ff5-339923fb9ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab59af651984540b6643f39db7f02c2, user_id=0b315c1f2933477b80283cdc1c9bb9a9, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:39.919451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc740766-fd7e-44fb-9ff5-339923fb9ce9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:39.979149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:39.979149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.004053 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6325b8-80ff-43ab-a5bc-ff81e2b77093 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.010560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1018/2052] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:39 2022] PUT /identity/v3/projects/1ab59af651984540b6643f39db7f02c2/users/0b315c1f2933477b80283cdc1c9bb9a9/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:40.016610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc740766-fd7e-44fb-9ff5-339923fb9ce9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.069470 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.070127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.070410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.071307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] PATH_INFO: `/v3/projects/9efd53caf9864dc7a4822c0a18d1c688` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.071970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efd53caf9864dc7a4822c0a18d1c688)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.074032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.086675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc740766-fd7e-44fb-9ff5-339923fb9ce9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.091936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.092582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.092818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.093106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.093761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.095445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.105439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1019/2053] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:40.106253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.107937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.121244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f524a2-1757-43e3-aa08-57adfd6ce860 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.126040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.127312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.127591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.127862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] PATH_INFO: `/v3/users/2b9009d3013f4607bf0ffcf93c27c58f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.128986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9009d3013f4607bf0ffcf93c27c58f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.130958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.174624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efd53caf9864dc7a4822c0a18d1c688', 'request_id': 'req-1f558a29-4283-4614-a01f-665f0f439581'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.179933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efd53caf9864dc7a4822c0a18d1c688', 'request_id': 'req-1f558a29-4283-4614-a01f-665f0f439581'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.185975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efd53caf9864dc7a4822c0a18d1c688', 'request_id': 'req-1f558a29-4283-4614-a01f-665f0f439581'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.266564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:40.271341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] The token cache is being invalidate because project 9efd53caf9864dc7a4822c0a18d1c688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:40.271633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.272274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.273784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1035/2054] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:39 2022] DELETE /identity/v3/projects/9efd53caf9864dc7a4822c0a18d1c688 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:40.274544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.275813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.301235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9009d3013f4607bf0ffcf93c27c58f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.337243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f558a29-4283-4614-a01f-665f0f439581 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.341923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf52d4-3d71-4a97-b009-db69a1c332a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.342593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf52d4-3d71-4a97-b009-db69a1c332a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.342869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf52d4-3d71-4a97-b009-db69a1c332a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.343139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf52d4-3d71-4a97-b009-db69a1c332a6 admin admin] PATH_INFO: `/v3/projects/1ab59af651984540b6643f39db7f02c2/users/0b315c1f2933477b80283cdc1c9bb9a9/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.345491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf52d4-3d71-4a97-b009-db69a1c332a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab59af651984540b6643f39db7f02c2, user_id=0b315c1f2933477b80283cdc1c9bb9a9, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.348256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf52d4-3d71-4a97-b009-db69a1c332a6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.358174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1036/2055] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:40 2022] PUT /identity/v3/projects/1ab59af651984540b6643f39db7f02c2/users/0b315c1f2933477b80283cdc1c9bb9a9/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:40.359349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2eb16-91a5-4d7d-8a0c-9ab420098343 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.362075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2eb16-91a5-4d7d-8a0c-9ab420098343 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.362075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2eb16-91a5-4d7d-8a0c-9ab420098343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.373900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9009d3013f4607bf0ffcf93c27c58f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.379795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-96e2eb16-91a5-4d7d-8a0c-9ab420098343 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:40.381012 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-96e2eb16-91a5-4d7d-8a0c-9ab420098343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.381370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9009d3013f4607bf0ffcf93c27c58f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.393829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9009d3013f4607bf0ffcf93c27c58f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.394660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21628149-77f6-4823-850a-ab35969700fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9009d3013f4607bf0ffcf93c27c58f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:40.400688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1020/2056] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:40 2022] DELETE /identity/v3/users/2b9009d3013f4607bf0ffcf93c27c58f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:40.404784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c01656-5f18-447c-8970-d7682e5d8529 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.405065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c01656-5f18-447c-8970-d7682e5d8529 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.405336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c01656-5f18-447c-8970-d7682e5d8529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.434341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d8c01656-5f18-447c-8970-d7682e5d8529 None None] MFA Rules not processed for user `0b315c1f2933477b80283cdc1c9bb9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:40.435498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8c01656-5f18-447c-8970-d7682e5d8529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.442056 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1037/2057] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:40.443410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135290-be84-4a16-ad2b-0412b3f26bf5 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.443796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135290-be84-4a16-ad2b-0412b3f26bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.443955 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57135290-be84-4a16-ad2b-0412b3f26bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.462800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-57135290-be84-4a16-ad2b-0412b3f26bf5 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:40.464014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-57135290-be84-4a16-ad2b-0412b3f26bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.503536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1021/2058] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:40.504931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acc1b-e63b-4fea-8553-8976f22c924c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.505269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acc1b-e63b-4fea-8553-8976f22c924c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.505596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acc1b-e63b-4fea-8553-8976f22c924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.522888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1038/2059] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:40.523828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57135290-be84-4a16-ad2b-0412b3f26bf5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.525168 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-57135290-be84-4a16-ad2b-0412b3f26bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.525398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-901acc1b-e63b-4fea-8553-8976f22c924c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:40.526799 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-901acc1b-e63b-4fea-8553-8976f22c924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.535673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1022/2060] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:40.535673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acc1b-e63b-4fea-8553-8976f22c924c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.535673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-901acc1b-e63b-4fea-8553-8976f22c924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.545168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:40.588178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57135290-be84-4a16-ad2b-0412b3f26bf5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.592108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.592772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.593122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.593458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.596051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:40.600075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acc1b-e63b-4fea-8553-8976f22c924c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.604073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316f695-989f-43da-a2de-6be2c0a6bdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.604718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f695-989f-43da-a2de-6be2c0a6bdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.605288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f695-989f-43da-a2de-6be2c0a6bdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.605417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f695-989f-43da-a2de-6be2c0a6bdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.615017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316f695-989f-43da-a2de-6be2c0a6bdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.616565 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316f695-989f-43da-a2de-6be2c0a6bdc1 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.626336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1023/2061] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:40.627438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316f695-989f-43da-a2de-6be2c0a6bdc1 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.646932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316f695-989f-43da-a2de-6be2c0a6bdc1 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.646932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.646932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.646932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.647876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.647876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:40.647876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.647876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.660619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1024/2062] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:40.664607 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.676397 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0f1a-98d6-4814-8326-f9ad7d4840cc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.681976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0ce44-85b3-429c-a782-ba46ae130820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.682665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ce44-85b3-429c-a782-ba46ae130820 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.683025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ce44-85b3-429c-a782-ba46ae130820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.683303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ce44-85b3-429c-a782-ba46ae130820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.684087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0ce44-85b3-429c-a782-ba46ae130820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.686242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0ce44-85b3-429c-a782-ba46ae130820 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.696559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.698130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.708564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1039/2063] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:40.800045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1025/2064] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:40 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:40.803980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.815681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2baf-1401-488e-8e15-870d6707ddaa service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.877225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e75f12-2975-4806-8dcb-48d0d95cde6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.877857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e75f12-2975-4806-8dcb-48d0d95cde6f admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.878129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e75f12-2975-4806-8dcb-48d0d95cde6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.878396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e75f12-2975-4806-8dcb-48d0d95cde6f admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.879041 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e75f12-2975-4806-8dcb-48d0d95cde6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:40.880932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e75f12-2975-4806-8dcb-48d0d95cde6f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:40.969199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1040/2065] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:40 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:40.973491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0ce44-85b3-429c-a782-ba46ae130820 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:40.990001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0ce44-85b3-429c-a782-ba46ae130820 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:40.995949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6bec-f52a-4657-b238-e99e5ed89efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:40.996693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6bec-f52a-4657-b238-e99e5ed89efc admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:40.997371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6bec-f52a-4657-b238-e99e5ed89efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:40.997371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6bec-f52a-4657-b238-e99e5ed89efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:40.998032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f6bec-f52a-4657-b238-e99e5ed89efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:41.000184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f6bec-f52a-4657-b238-e99e5ed89efc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:41.010694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1026/2066] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:41.014715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e75f12-2975-4806-8dcb-48d0d95cde6f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:41.025528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e75f12-2975-4806-8dcb-48d0d95cde6f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:41.030655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a47aa5-c41c-42ad-8a71-0d3274c3af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:41.030958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47aa5-c41c-42ad-8a71-0d3274c3af76 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:41.031233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47aa5-c41c-42ad-8a71-0d3274c3af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:41.031500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47aa5-c41c-42ad-8a71-0d3274c3af76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:41.032139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a47aa5-c41c-42ad-8a71-0d3274c3af76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:41.033759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a47aa5-c41c-42ad-8a71-0d3274c3af76 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:41.044325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1041/2067] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:41.048521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6bec-f52a-4657-b238-e99e5ed89efc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:41.059347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f6bec-f52a-4657-b238-e99e5ed89efc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:41.064719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:41.065395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:41.065667 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:41.065932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] PATH_INFO: `/v3/projects/7152faeea5854743841712b6080bf632/users/a5ffc000032c455dbc467b3c4b93dffe/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:41.081491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7152faeea5854743841712b6080bf632, user_id=a5ffc000032c455dbc467b3c4b93dffe, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:41.084182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:41.173546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1027/2068] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:41 2022] PUT /identity/v3/projects/7152faeea5854743841712b6080bf632/users/a5ffc000032c455dbc467b3c4b93dffe/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:41.184739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fde1-7aea-4beb-a2ab-aa7a68e35a0f None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:41.185024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fde1-7aea-4beb-a2ab-aa7a68e35a0f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:41.185297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fde1-7aea-4beb-a2ab-aa7a68e35a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:41.213570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ecc4fde1-7aea-4beb-a2ab-aa7a68e35a0f None None] MFA Rules not processed for user `a5ffc000032c455dbc467b3c4b93dffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:41.214726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ecc4fde1-7aea-4beb-a2ab-aa7a68e35a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:41.233622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:41.235675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:41.278077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:41.289919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1042/2069] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:41.301737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4fde1-7aea-4beb-a2ab-aa7a68e35a0f None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:41.303086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ecc4fde1-7aea-4beb-a2ab-aa7a68e35a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:41.312810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b43ae-c245-4020-b669-0adc5611d16d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:41.318166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:41.318821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:41.319099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:41.319369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] PATH_INFO: `/v3/projects/561ec673e2964d14b94ebc9c9f7f290e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:41.320563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561ec673e2964d14b94ebc9c9f7f290e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:41.322477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:41.372620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4fde1-7aea-4beb-a2ab-aa7a68e35a0f None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:41.377072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3514e3-1ae7-43ff-8f4d-30ce2c062cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:41.377696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3514e3-1ae7-43ff-8f4d-30ce2c062cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:41.377974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3514e3-1ae7-43ff-8f4d-30ce2c062cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:41.378242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3514e3-1ae7-43ff-8f4d-30ce2c062cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:41.387310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3514e3-1ae7-43ff-8f4d-30ce2c062cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:41.388723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3514e3-1ae7-43ff-8f4d-30ce2c062cd5 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:41.397822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1043/2070] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:41.420143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3514e3-1ae7-43ff-8f4d-30ce2c062cd5 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:41.431732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:41.432230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3514e3-1ae7-43ff-8f4d-30ce2c062cd5 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:41.436482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:41.437098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:41.437380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:41.437704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] PATH_INFO: `/v3/users/a5ffc000032c455dbc467b3c4b93dffe` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:41.439410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ffc000032c455dbc467b3c4b93dffe)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:41.441319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:41.512269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561ec673e2964d14b94ebc9c9f7f290e', 'request_id': 'req-975aaeaa-10f3-4c1d-8078-804058bd0fa9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.580151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561ec673e2964d14b94ebc9c9f7f290e', 'request_id': 'req-975aaeaa-10f3-4c1d-8078-804058bd0fa9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.588326 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561ec673e2964d14b94ebc9c9f7f290e', 'request_id': 'req-975aaeaa-10f3-4c1d-8078-804058bd0fa9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.599134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] The token cache is being invalidate because project 561ec673e2964d14b94ebc9c9f7f290e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:41.599413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.600205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.602033 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1028/2071] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:41 2022] DELETE /identity/v3/projects/561ec673e2964d14b94ebc9c9f7f290e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:41.605944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:41.607326 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:41.672730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aaeaa-10f3-4c1d-8078-804058bd0fa9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:41.678116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:41.678776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:41.679050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:41.679316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] PATH_INFO: `/v3/users/f76bdff3214f44b98d9aa2273ae5c2b4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:41.680448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76bdff3214f44b98d9aa2273ae5c2b4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:41.682858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:41.699174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ffc000032c455dbc467b3c4b93dffe'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.711458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ffc000032c455dbc467b3c4b93dffe'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.825931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ffc000032c455dbc467b3c4b93dffe'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.827637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:41.828276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ffc000032c455dbc467b3c4b93dffe'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.840582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d559cce2-e6c8-4d54-8698-1df6f247f157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ffc000032c455dbc467b3c4b93dffe'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.846998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1044/2072] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:41 2022] DELETE /identity/v3/users/a5ffc000032c455dbc467b3c4b93dffe => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:41.852045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c98b3-dafe-4a0b-bcc8-6dd61655c413 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:41.852657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c98b3-dafe-4a0b-bcc8-6dd61655c413 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:41.852938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c98b3-dafe-4a0b-bcc8-6dd61655c413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:41.874207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3e8c98b3-dafe-4a0b-bcc8-6dd61655c413 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:41.875465 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3e8c98b3-dafe-4a0b-bcc8-6dd61655c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:41.940489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76bdff3214f44b98d9aa2273ae5c2b4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:41.942491 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1045/2073] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:41.952369 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c98b3-dafe-4a0b-bcc8-6dd61655c413 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:41.953865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3e8c98b3-dafe-4a0b-bcc8-6dd61655c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:41.987035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:42.008926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76bdff3214f44b98d9aa2273ae5c2b4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:42.015512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c98b3-dafe-4a0b-bcc8-6dd61655c413 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:42.017022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76bdff3214f44b98d9aa2273ae5c2b4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:42.019755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:42.020364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:42.020650 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:42.020907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:42.031315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:42.031608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76bdff3214f44b98d9aa2273ae5c2b4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:42.036747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e2307f6-41ed-4ca5-b9f1-25a88ac9157d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76bdff3214f44b98d9aa2273ae5c2b4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:42.036861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:42.040380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1029/2074] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:41 2022] DELETE /identity/v3/users/f76bdff3214f44b98d9aa2273ae5c2b4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:42.041841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e76e4-af42-41d6-8c97-8db2959d595d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:42.042172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e76e4-af42-41d6-8c97-8db2959d595d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:42.042427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e76e4-af42-41d6-8c97-8db2959d595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:42.065242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1046/2075] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:42.065516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c49e76e4-af42-41d6-8c97-8db2959d595d None None] MFA Rules not processed for user `827e8de6dbf84bdd809a359b5bf5a6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:42.065516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c49e76e4-af42-41d6-8c97-8db2959d595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:42.120343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1030/2076] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:42.248973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:42.746404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:42.748235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:42.772235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9160e0-f78c-413b-9852-49f7b0410ec8 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:42.780470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e76e4-af42-41d6-8c97-8db2959d595d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:42.782030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c49e76e4-af42-41d6-8c97-8db2959d595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:42.896268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:42.897005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:42.897355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:42.897701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] PATH_INFO: `/v3/projects/5c9f7f492d8f40198994c39c3e532e0b` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:42.900715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9f7f492d8f40198994c39c3e532e0b)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:42.903007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:42.908507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e76e4-af42-41d6-8c97-8db2959d595d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:42.918853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:42.919528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:42.919806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:42.920077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] PATH_INFO: `/v3/projects/7152faeea5854743841712b6080bf632` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:42.921336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7152faeea5854743841712b6080bf632)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:42.924528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:42.976327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:43.073733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7152faeea5854743841712b6080bf632', 'request_id': 'req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.115206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9f7f492d8f40198994c39c3e532e0b', 'request_id': 'req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.120908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9f7f492d8f40198994c39c3e532e0b', 'request_id': 'req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.127311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9f7f492d8f40198994c39c3e532e0b', 'request_id': 'req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.168619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7152faeea5854743841712b6080bf632', 'request_id': 'req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.176357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7152faeea5854743841712b6080bf632', 'request_id': 'req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.197538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] The token cache is being invalidate because project 7152faeea5854743841712b6080bf632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:43.197830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.198511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a11cf20c-dedb-4f15-9a37-acf4b5ca31ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.200036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1031/2077] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:42 2022] DELETE /identity/v3/projects/7152faeea5854743841712b6080bf632 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:43.205485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5b850-ce12-4af3-9f55-67df30c18720 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.205772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5b850-ce12-4af3-9f55-67df30c18720 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.206048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5b850-ce12-4af3-9f55-67df30c18720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.236600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-64f5b850-ce12-4af3-9f55-67df30c18720 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:43.237888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-64f5b850-ce12-4af3-9f55-67df30c18720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:43.250805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] The token cache is being invalidate because project 5c9f7f492d8f40198994c39c3e532e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:43.251658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.252516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dcf5d00-db6f-4358-b93f-e0e2c03b4ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:43.254492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1047/2078] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:42 2022] DELETE /identity/v3/projects/5c9f7f492d8f40198994c39c3e532e0b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:43.258958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37f8e-aba5-45de-9709-765f18bbbd6f None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.259363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37f8e-aba5-45de-9709-765f18bbbd6f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.259735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a37f8e-aba5-45de-9709-765f18bbbd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.279902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-69a37f8e-aba5-45de-9709-765f18bbbd6f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:43.281268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-69a37f8e-aba5-45de-9709-765f18bbbd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:43.318530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1032/2079] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:43.326224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932068-627f-4077-a2ab-2e345d64c568 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.326555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932068-627f-4077-a2ab-2e345d64c568 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.327088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932068-627f-4077-a2ab-2e345d64c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.359040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8d932068-627f-4077-a2ab-2e345d64c568 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:43.360381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8d932068-627f-4077-a2ab-2e345d64c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:43.370024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1048/2080] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:43.370590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1033/2081] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:43.373355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37f8e-aba5-45de-9709-765f18bbbd6f None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.381237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de04a8-7d3e-440a-96ce-00f6d0ef5f6b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.381237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de04a8-7d3e-440a-96ce-00f6d0ef5f6b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.381237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de04a8-7d3e-440a-96ce-00f6d0ef5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.383645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a37f8e-aba5-45de-9709-765f18bbbd6f None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.388367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.388967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.389239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.389521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.390307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:43.390638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.392863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.401255 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-98de04a8-7d3e-440a-96ce-00f6d0ef5f6b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:43.402804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-98de04a8-7d3e-440a-96ce-00f6d0ef5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:43.408653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1049/2082] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:42:43.410362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.414439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1034/2083] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:43.417606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de04a8-7d3e-440a-96ce-00f6d0ef5f6b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.420538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6196014-247f-413f-9118-b6cdca8ab83e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.426270 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38be5-ed57-4b81-80ff-5b618e572f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.426910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38be5-ed57-4b81-80ff-5b618e572f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.427190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38be5-ed57-4b81-80ff-5b618e572f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.427290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de04a8-7d3e-440a-96ce-00f6d0ef5f6b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.427939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38be5-ed57-4b81-80ff-5b618e572f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.428136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d38be5-ed57-4b81-80ff-5b618e572f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.430167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d38be5-ed57-4b81-80ff-5b618e572f79 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.432636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.433431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.433623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.433892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.434710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:43.442256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.444060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.468360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1035/2084] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:42:43.472681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.482858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d713d-d3d8-4984-b9ee-d4b98e5974f1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.487747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535be832-37a4-4398-b060-e84efd9d7593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.488375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be832-37a4-4398-b060-e84efd9d7593 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.488652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be832-37a4-4398-b060-e84efd9d7593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.488920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be832-37a4-4398-b060-e84efd9d7593 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.489541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535be832-37a4-4398-b060-e84efd9d7593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.491480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535be832-37a4-4398-b060-e84efd9d7593 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.571405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1050/2085] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:43 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:43.575554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38be5-ed57-4b81-80ff-5b618e572f79 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.594308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1036/2086] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:43 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:43.598162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535be832-37a4-4398-b060-e84efd9d7593 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.640776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38be5-ed57-4b81-80ff-5b618e572f79 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.662350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535be832-37a4-4398-b060-e84efd9d7593 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.668101 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.668717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.668992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.669260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.669945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.672237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.701637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230e3fc-ccaa-4d7a-8450-dcc5ec8be952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.702336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e3fc-ccaa-4d7a-8450-dcc5ec8be952 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.702652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e3fc-ccaa-4d7a-8450-dcc5ec8be952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.702921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e3fc-ccaa-4d7a-8450-dcc5ec8be952 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.703751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230e3fc-ccaa-4d7a-8450-dcc5ec8be952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.705998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230e3fc-ccaa-4d7a-8450-dcc5ec8be952 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.791510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1037/2087] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:43 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:43.792387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.794012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:43.848628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1051/2088] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:43 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:42:43.850219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230e3fc-ccaa-4d7a-8450-dcc5ec8be952 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.851552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deda0b-65ed-4f15-80a5-3132ff4b85f0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.855439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.856047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.856326 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.856601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.858416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:43.860229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230e3fc-ccaa-4d7a-8450-dcc5ec8be952 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.865451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aa8ad-570a-4ad8-9695-6aa9267d72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.866038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aa8ad-570a-4ad8-9695-6aa9267d72d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.866316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aa8ad-570a-4ad8-9695-6aa9267d72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.866618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aa8ad-570a-4ad8-9695-6aa9267d72d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.874691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aa8ad-570a-4ad8-9695-6aa9267d72d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.874691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aa8ad-570a-4ad8-9695-6aa9267d72d6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.879526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1052/2089] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:43.880086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aa8ad-570a-4ad8-9695-6aa9267d72d6 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.889894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aa8ad-570a-4ad8-9695-6aa9267d72d6 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.894977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597622e-3c3b-461f-b888-31dbf22fc33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.895565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597622e-3c3b-461f-b888-31dbf22fc33d admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.895845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597622e-3c3b-461f-b888-31dbf22fc33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.896109 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597622e-3c3b-461f-b888-31dbf22fc33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.896804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597622e-3c3b-461f-b888-31dbf22fc33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.898451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597622e-3c3b-461f-b888-31dbf22fc33d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.910080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1053/2090] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:43.910933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597622e-3c3b-461f-b888-31dbf22fc33d admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.920657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597622e-3c3b-461f-b888-31dbf22fc33d admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.928185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.929644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.931939 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7195928-0579-468a-abbd-f8096c3f4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.932495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7195928-0579-468a-abbd-f8096c3f4631 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.932770 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7195928-0579-468a-abbd-f8096c3f4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.933039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7195928-0579-468a-abbd-f8096c3f4631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.933679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7195928-0579-468a-abbd-f8096c3f4631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.935278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7195928-0579-468a-abbd-f8096c3f4631 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.939440 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1038/2091] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:43.943383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.945665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1054/2092] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:43.954823 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd4a25-c037-44a9-b232-6fb163ac86d8 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.956095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7195928-0579-468a-abbd-f8096c3f4631 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.960310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a837-247f-45f4-8a89-7a369dac6dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.964240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a837-247f-45f4-8a89-7a369dac6dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.964240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a837-247f-45f4-8a89-7a369dac6dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.964240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a837-247f-45f4-8a89-7a369dac6dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.964240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a837-247f-45f4-8a89-7a369dac6dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:43.964558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a837-247f-45f4-8a89-7a369dac6dd1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:43.970396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7195928-0579-468a-abbd-f8096c3f4631 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:43.975779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f8423-659d-478a-b908-9abf5837d225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:43.976512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8423-659d-478a-b908-9abf5837d225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:43.976883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8423-659d-478a-b908-9abf5837d225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:43.977227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f8423-659d-478a-b908-9abf5837d225 admin admin] PATH_INFO: `/v3/projects/3935cb6cb9d74e22ac777acadc894707/users/d10f2062e8a24168904ee08c8e4a5f1b/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:43.978351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1039/2093] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:43.982333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a837-247f-45f4-8a89-7a369dac6dd1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:43.997671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f8423-659d-478a-b908-9abf5837d225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3935cb6cb9d74e22ac777acadc894707, user_id=d10f2062e8a24168904ee08c8e4a5f1b, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:44.000392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f8423-659d-478a-b908-9abf5837d225 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:44.005193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:44.008208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a837-247f-45f4-8a89-7a369dac6dd1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:44.013425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426701-4d8d-4d44-b89a-90404691f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:44.014176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426701-4d8d-4d44-b89a-90404691f436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:44.014570 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426701-4d8d-4d44-b89a-90404691f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:44.014905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426701-4d8d-4d44-b89a-90404691f436 admin admin] PATH_INFO: `/v3/projects/f490832d8b71427badbc78ae5eaa067e/users/ce10b9c62eea4f0e976c6723a7e081ab/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:44.030790 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426701-4d8d-4d44-b89a-90404691f436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f490832d8b71427badbc78ae5eaa067e, user_id=ce10b9c62eea4f0e976c6723a7e081ab, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:44.034672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426701-4d8d-4d44-b89a-90404691f436 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:44.112041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1040/2094] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:43 2022] PUT /identity/v3/projects/f490832d8b71427badbc78ae5eaa067e/users/ce10b9c62eea4f0e976c6723a7e081ab/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:44.112419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1055/2095] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:43 2022] PUT /identity/v3/projects/3935cb6cb9d74e22ac777acadc894707/users/d10f2062e8a24168904ee08c8e4a5f1b/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:44.122227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ee2a2-0fdb-4380-95ba-7e3bab38e4b3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:44.122410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ff53-e6fb-4fb9-9eeb-a909ae40b4f2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:44.122532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ee2a2-0fdb-4380-95ba-7e3bab38e4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:44.122643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ff53-e6fb-4fb9-9eeb-a909ae40b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:44.122789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ee2a2-0fdb-4380-95ba-7e3bab38e4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:44.122883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ff53-e6fb-4fb9-9eeb-a909ae40b4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:44.151951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3d3ee2a2-0fdb-4380-95ba-7e3bab38e4b3 None None] MFA Rules not processed for user `d10f2062e8a24168904ee08c8e4a5f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:44.153161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3d3ee2a2-0fdb-4380-95ba-7e3bab38e4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:44.153782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7216ff53-e6fb-4fb9-9eeb-a909ae40b4f2 None None] MFA Rules not processed for user `ce10b9c62eea4f0e976c6723a7e081ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:44.155021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7216ff53-e6fb-4fb9-9eeb-a909ae40b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:44.218576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1056/2096] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:44.221896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1041/2097] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:44.230344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ee2a2-0fdb-4380-95ba-7e3bab38e4b3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:44.231750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3d3ee2a2-0fdb-4380-95ba-7e3bab38e4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:44.236480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216ff53-e6fb-4fb9-9eeb-a909ae40b4f2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:44.237869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7216ff53-e6fb-4fb9-9eeb-a909ae40b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:44.264156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:44.298959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ee2a2-0fdb-4380-95ba-7e3bab38e4b3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:44.302888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3de81-ff60-47d3-afa1-e9899013be3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:44.303340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3de81-ff60-47d3-afa1-e9899013be3e service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:44.303619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3de81-ff60-47d3-afa1-e9899013be3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:44.303885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3de81-ff60-47d3-afa1-e9899013be3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:44.313038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3de81-ff60-47d3-afa1-e9899013be3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:44.314605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3de81-ff60-47d3-afa1-e9899013be3e service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:44.324266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1057/2098] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:44.358858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216ff53-e6fb-4fb9-9eeb-a909ae40b4f2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:44.366360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb458a6186814aadb4ef178ff199582c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:44.368465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:44.368465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:44.368465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:44.380130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:44.381902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:44.394543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1042/2099] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:42:45.228007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:45.581043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:45.672522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3de81-ff60-47d3-afa1-e9899013be3e service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:45.681210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3de81-ff60-47d3-afa1-e9899013be3e service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:45.685025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aa66b-6f45-4fe1-a43c-24f15c5d4ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:45.685592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa66b-6f45-4fe1-a43c-24f15c5d4ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:45.685874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa66b-6f45-4fe1-a43c-24f15c5d4ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:45.686144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa66b-6f45-4fe1-a43c-24f15c5d4ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:45.688052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-560aa66b-6f45-4fe1-a43c-24f15c5d4ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:45.756975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aa66b-6f45-4fe1-a43c-24f15c5d4ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:45.758511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aa66b-6f45-4fe1-a43c-24f15c5d4ab0 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:45.770238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1058/2100] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:46.099936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:46.682431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:47.260921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:48.226049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:48.785154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:49.727885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:49.801610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:50.683524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:50.935948 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:51.822619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:51.824093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:51.892426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3553b-630a-4196-bb5b-ada8dd320ee6 service glance] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:51.897952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:51.898677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:51.899013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:51.899340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] PATH_INFO: `/v3/users/af3c2272ed9f4ef6a851ae7ba47a6bdf` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:51.904067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3c2272ed9f4ef6a851ae7ba47a6bdf)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:51.906078 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:52.039816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:52.045949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3c2272ed9f4ef6a851ae7ba47a6bdf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:52.098755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3c2272ed9f4ef6a851ae7ba47a6bdf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:52.107371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3c2272ed9f4ef6a851ae7ba47a6bdf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:52.123268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3c2272ed9f4ef6a851ae7ba47a6bdf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:52.124195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3c2272ed9f4ef6a851ae7ba47a6bdf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:52.131251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1043/2101] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:51 2022] DELETE /identity/v3/users/af3c2272ed9f4ef6a851ae7ba47a6bdf => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:52.135816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83df2-e153-494c-aade-dee5a05296c9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:52.136322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83df2-e153-494c-aade-dee5a05296c9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:52.136407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83df2-e153-494c-aade-dee5a05296c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:52.159023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bbd83df2-e153-494c-aade-dee5a05296c9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:52.160716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bbd83df2-e153-494c-aade-dee5a05296c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:52.242676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1059/2102] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:42:52.259302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:52.261714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:52.325353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886be916-4f19-4ee0-9694-f48080344b07 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:52.329136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acccda3-27ac-4402-9b10-5b549e560a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:52.329742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acccda3-27ac-4402-9b10-5b549e560a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:52.330412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acccda3-27ac-4402-9b10-5b549e560a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:52.330412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acccda3-27ac-4402-9b10-5b549e560a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:52.339834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acccda3-27ac-4402-9b10-5b549e560a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:52.341349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acccda3-27ac-4402-9b10-5b549e560a24 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:52.351811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1044/2103] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:52.885133 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd83df2-e153-494c-aade-dee5a05296c9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:52.886922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bbd83df2-e153-494c-aade-dee5a05296c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:52.905689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd83df2-e153-494c-aade-dee5a05296c9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:52.913203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:52.913846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:52.914126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:52.914435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] PATH_INFO: `/v3/projects/3806f79f5af74ccdb241f71b5bfe47d3` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:52.916372 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3806f79f5af74ccdb241f71b5bfe47d3)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:52.918837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:53.089215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3806f79f5af74ccdb241f71b5bfe47d3', 'request_id': 'req-20f3e207-e334-4337-842a-80a964dbcd4a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.101054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3806f79f5af74ccdb241f71b5bfe47d3', 'request_id': 'req-20f3e207-e334-4337-842a-80a964dbcd4a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.108889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3806f79f5af74ccdb241f71b5bfe47d3', 'request_id': 'req-20f3e207-e334-4337-842a-80a964dbcd4a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.185265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] The token cache is being invalidate because project 3806f79f5af74ccdb241f71b5bfe47d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:53.186043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.186283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.188516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1060/2104] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:52 2022] DELETE /identity/v3/projects/3806f79f5af74ccdb241f71b5bfe47d3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:53.193362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acccda3-27ac-4402-9b10-5b549e560a24 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:53.206422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acccda3-27ac-4402-9b10-5b549e560a24 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:53.352129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:53.354100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:53.358176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:53.358176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] PATH_INFO: `/v3/users/8e0a1f0344954270bc9774e0e55cf1ec` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:53.374377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0a1f0344954270bc9774e0e55cf1ec)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:53.374377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:53.584561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0a1f0344954270bc9774e0e55cf1ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.694736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0a1f0344954270bc9774e0e55cf1ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.701236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:53.703215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0a1f0344954270bc9774e0e55cf1ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.714820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0a1f0344954270bc9774e0e55cf1ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.715603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0a1f0344954270bc9774e0e55cf1ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:53.722786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1045/2105] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:53 2022] DELETE /identity/v3/users/8e0a1f0344954270bc9774e0e55cf1ec => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:54.360986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:54.362830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:54.385280 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e207-e334-4337-842a-80a964dbcd4a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:54.491781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:54.492999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:54.493460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:54.493750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] PATH_INFO: `/v3/projects/8577dc05c99c4d5d95a43d654f01d944` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:54.495132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8577dc05c99c4d5d95a43d654f01d944)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:54.497234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:54.498995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:54.616125 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8577dc05c99c4d5d95a43d654f01d944', 'request_id': 'req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:54.622164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8577dc05c99c4d5d95a43d654f01d944', 'request_id': 'req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:54.629754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8577dc05c99c4d5d95a43d654f01d944', 'request_id': 'req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:54.734364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] The token cache is being invalidate because project 8577dc05c99c4d5d95a43d654f01d944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:54.734787 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:54.735540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:54.737129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1061/2106] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:54 2022] DELETE /identity/v3/projects/8577dc05c99c4d5d95a43d654f01d944 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:54.741484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:54.743089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:54.757083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad927a-c8b2-4730-a367-7260a8978330 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:54.823792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:54.824528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:54.824801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:54.825073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] PATH_INFO: `/v3/users/0b315c1f2933477b80283cdc1c9bb9a9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:54.826215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b315c1f2933477b80283cdc1c9bb9a9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:54.828178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:55.060487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b315c1f2933477b80283cdc1c9bb9a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:55.127659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b315c1f2933477b80283cdc1c9bb9a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:55.135946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b315c1f2933477b80283cdc1c9bb9a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:55.151035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b315c1f2933477b80283cdc1c9bb9a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:55.151786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-077762e1-c629-485a-88ba-0396e816ac83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b315c1f2933477b80283cdc1c9bb9a9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:55.159982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1046/2107] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:54 2022] DELETE /identity/v3/users/0b315c1f2933477b80283cdc1c9bb9a9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:55.752935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:55.756363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:55.775736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b9f54-96eb-4e37-8b8e-0c1c4a1900f8 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:55.870075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:55.870755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:55.871362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:55.871642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] PATH_INFO: `/v3/projects/1ab59af651984540b6643f39db7f02c2` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:55.872951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab59af651984540b6643f39db7f02c2)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:55.876542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:56.054977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab59af651984540b6643f39db7f02c2', 'request_id': 'req-89eb8bc0-fe14-4b5c-9110-303d9886fa26'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.061642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab59af651984540b6643f39db7f02c2', 'request_id': 'req-89eb8bc0-fe14-4b5c-9110-303d9886fa26'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.068183 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab59af651984540b6643f39db7f02c2', 'request_id': 'req-89eb8bc0-fe14-4b5c-9110-303d9886fa26'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.150826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] The token cache is being invalidate because project 1ab59af651984540b6643f39db7f02c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:56.151354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.152038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-89eb8bc0-fe14-4b5c-9110-303d9886fa26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.153594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1062/2108] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:55 2022] DELETE /identity/v3/projects/1ab59af651984540b6643f39db7f02c2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:56.278549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba824d-e595-42a9-ac12-9dc6081a4270 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:56.279558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba824d-e595-42a9-ac12-9dc6081a4270 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:56.279973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba824d-e595-42a9-ac12-9dc6081a4270 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:56.282599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1047/2109] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:42:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:42:56.335673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb5ba6-1892-48f1-a80e-c7c2735ed50f None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:56.336900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb5ba6-1892-48f1-a80e-c7c2735ed50f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:56.337359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb5ba6-1892-48f1-a80e-c7c2735ed50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:56.376344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1fdb5ba6-1892-48f1-a80e-c7c2735ed50f None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:56.377585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1fdb5ba6-1892-48f1-a80e-c7c2735ed50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:56.393346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:56.447945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1063/2110] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:42:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:56.459961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba824d-e595-42a9-ac12-9dc6081a4270 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:56.461853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1aba824d-e595-42a9-ac12-9dc6081a4270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:56.472181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb5ba6-1892-48f1-a80e-c7c2735ed50f None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:56.473700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1fdb5ba6-1892-48f1-a80e-c7c2735ed50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:56.488907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba824d-e595-42a9-ac12-9dc6081a4270 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:56.494650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e84cc0-33c0-429c-9fc6-a7561f418ef9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:56.495359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84cc0-33c0-429c-9fc6-a7561f418ef9 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:56.495697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84cc0-33c0-429c-9fc6-a7561f418ef9 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:56.497524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84cc0-33c0-429c-9fc6-a7561f418ef9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:56.505460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e84cc0-33c0-429c-9fc6-a7561f418ef9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:56.507408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e84cc0-33c0-429c-9fc6-a7561f418ef9 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:56.519573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1048/2111] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:42:56.569724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb5ba6-1892-48f1-a80e-c7c2735ed50f None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:56.575655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:56.576298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:56.576609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:56.576851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] PATH_INFO: `/v3/users/527fdf5cf2af40c893b0e4ef9dc4e486` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:56.578013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=527fdf5cf2af40c893b0e4ef9dc4e486)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:56.580535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:56.791878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527fdf5cf2af40c893b0e4ef9dc4e486'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.798816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527fdf5cf2af40c893b0e4ef9dc4e486'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.905583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527fdf5cf2af40c893b0e4ef9dc4e486'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.906227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527fdf5cf2af40c893b0e4ef9dc4e486'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.920352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1b989363-cb91-48ed-9b92-383cc03919ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527fdf5cf2af40c893b0e4ef9dc4e486'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:56.927010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1064/2112] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:42:56 2022] DELETE /identity/v3/users/527fdf5cf2af40c893b0e4ef9dc4e486 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:57.244780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e84cc0-33c0-429c-9fc6-a7561f418ef9 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:57.259642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e84cc0-33c0-429c-9fc6-a7561f418ef9 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:57.307409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:57.325140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:57.325842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:57.326290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:57.326550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] PATH_INFO: `/v3/projects/be3bd9804f144d64aa4984a3ba0e6e2b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:57.327758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3bd9804f144d64aa4984a3ba0e6e2b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:57.336537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:57.446805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'request_id': 'req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:57.522290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'request_id': 'req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:57.529104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'request_id': 'req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:57.539911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] The token cache is being invalidate because project be3bd9804f144d64aa4984a3ba0e6e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:42:57.540197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:57.540837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e6dcf9e9-b566-4a98-a9f3-d985cae1405e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:42:57.542335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1049/2113] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:42:57 2022] DELETE /identity/v3/projects/be3bd9804f144d64aa4984a3ba0e6e2b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:42:57.547558 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d850ec0-57a4-4750-8bf5-22448dd414db None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:57.547838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d850ec0-57a4-4750-8bf5-22448dd414db None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:57.548105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d850ec0-57a4-4750-8bf5-22448dd414db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:57.569462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3d850ec0-57a4-4750-8bf5-22448dd414db None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:57.570753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3d850ec0-57a4-4750-8bf5-22448dd414db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:57.601666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:57.631635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1065/2114] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:57.639503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1008-56a2-4ac8-8e03-64ade584cf93 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:57.639789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1008-56a2-4ac8-8e03-64ade584cf93 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:57.640120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1008-56a2-4ac8-8e03-64ade584cf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:57.661151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a3fc1008-56a2-4ac8-8e03-64ade584cf93 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:57.662377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a3fc1008-56a2-4ac8-8e03-64ade584cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:57.670403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1050/2115] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:57.674606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d850ec0-57a4-4750-8bf5-22448dd414db None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:57.684078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d850ec0-57a4-4750-8bf5-22448dd414db None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:57.689173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:57.689776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:57.690031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:57.690298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:57.690984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:42:57.691286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:57.693030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:57.705740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1066/2116] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:42:57.710049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1008-56a2-4ac8-8e03-64ade584cf93 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:57.719455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1008-56a2-4ac8-8e03-64ade584cf93 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:57.724188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aea9d7-c85f-4926-a38d-eaa1d0db0c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:57.724781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aea9d7-c85f-4926-a38d-eaa1d0db0c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:57.725057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aea9d7-c85f-4926-a38d-eaa1d0db0c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:57.725327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aea9d7-c85f-4926-a38d-eaa1d0db0c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:57.725954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aea9d7-c85f-4926-a38d-eaa1d0db0c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:57.727876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aea9d7-c85f-4926-a38d-eaa1d0db0c33 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:57.827254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1051/2117] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:42:57 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:57.831302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:57.841733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7483916-0738-496a-ad0f-dcfe71f78962 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:57.901140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735a4d-da9d-4bd3-8677-171d8b0cc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:57.901806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735a4d-da9d-4bd3-8677-171d8b0cc8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:57.902092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735a4d-da9d-4bd3-8677-171d8b0cc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:57.902365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735a4d-da9d-4bd3-8677-171d8b0cc8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:57.903110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2735a4d-da9d-4bd3-8677-171d8b0cc8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:57.905050 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2735a4d-da9d-4bd3-8677-171d8b0cc8d7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:57.991875 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1067/2118] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:42:57 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:42:57.995914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aea9d7-c85f-4926-a38d-eaa1d0db0c33 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:58.007253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aea9d7-c85f-4926-a38d-eaa1d0db0c33 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:58.011828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48188a9a-dbd5-4107-b6e4-732cad5cc2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:58.012442 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188a9a-dbd5-4107-b6e4-732cad5cc2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:58.012716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188a9a-dbd5-4107-b6e4-732cad5cc2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:58.012985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188a9a-dbd5-4107-b6e4-732cad5cc2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:58.013619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48188a9a-dbd5-4107-b6e4-732cad5cc2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:58.015353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48188a9a-dbd5-4107-b6e4-732cad5cc2f1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:58.025275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1052/2119] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:42:58.029412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735a4d-da9d-4bd3-8677-171d8b0cc8d7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:58.039699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735a4d-da9d-4bd3-8677-171d8b0cc8d7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:58.044534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69f872-f6e8-4ee5-a49c-cc937e7b7c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:58.045159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69f872-f6e8-4ee5-a49c-cc937e7b7c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:58.045439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69f872-f6e8-4ee5-a49c-cc937e7b7c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:58.045727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69f872-f6e8-4ee5-a49c-cc937e7b7c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:58.046410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69f872-f6e8-4ee5-a49c-cc937e7b7c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:58.048564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69f872-f6e8-4ee5-a49c-cc937e7b7c6a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:58.059671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1068/2120] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:42:58.064575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48188a9a-dbd5-4107-b6e4-732cad5cc2f1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:58.075154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48188a9a-dbd5-4107-b6e4-732cad5cc2f1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:58.080237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:58.080880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:58.081160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:58.081433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] PATH_INFO: `/v3/projects/934ce9d029694762938d6a2264fad07d/users/4542138b7aa5446b8544dc766cbcb372/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:58.097432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934ce9d029694762938d6a2264fad07d, user_id=4542138b7aa5446b8544dc766cbcb372, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:58.100322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:58.168552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1053/2121] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:42:58 2022] PUT /identity/v3/projects/934ce9d029694762938d6a2264fad07d/users/4542138b7aa5446b8544dc766cbcb372/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:42:58.174331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf8fc-7989-45ea-900a-4beaab65f44e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:58.174707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf8fc-7989-45ea-900a-4beaab65f44e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:58.174974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf8fc-7989-45ea-900a-4beaab65f44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:58.194316 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8e2cf8fc-7989-45ea-900a-4beaab65f44e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:42:58.195944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8e2cf8fc-7989-45ea-900a-4beaab65f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:58.258305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1069/2122] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:42:58.268311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:42:58.270004 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:42:58.461459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ba6b-a122-4c1d-b288-07da6a000650 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:42:58.466701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:42:58.467453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:42:58.467829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:42:58.468193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:42:58.480844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:42:58.482414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:42:58.493886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1054/2123] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:43:03.864827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f080c3b-05cd-4fc0-bfbb-4bd2cc7be17a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:03.865722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f080c3b-05cd-4fc0-bfbb-4bd2cc7be17a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:03.866218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f080c3b-05cd-4fc0-bfbb-4bd2cc7be17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:03.900089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3f080c3b-05cd-4fc0-bfbb-4bd2cc7be17a None None] MFA Rules not processed for user `4542138b7aa5446b8544dc766cbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:03.902296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3f080c3b-05cd-4fc0-bfbb-4bd2cc7be17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:03.943086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:03.984044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1070/2124] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:03.997865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:03.999434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:04.014225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:04.075842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a464e-d3ed-4ab5-81ac-c5b01bf3ffb0 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:04.083837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639e2e5-19b9-4e25-a7da-c7bc8b633316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:04.084485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639e2e5-19b9-4e25-a7da-c7bc8b633316 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:04.084758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639e2e5-19b9-4e25-a7da-c7bc8b633316 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:04.090100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639e2e5-19b9-4e25-a7da-c7bc8b633316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:04.093579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639e2e5-19b9-4e25-a7da-c7bc8b633316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:04.095875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639e2e5-19b9-4e25-a7da-c7bc8b633316 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:04.106619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1055/2125] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:43:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:43:07.231520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b413-c177-4948-b1f7-61b7587daf55 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:07.232555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b413-c177-4948-b1f7-61b7587daf55 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:07.233103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b413-c177-4948-b1f7-61b7587daf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:07.260716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bc79b413-c177-4948-b1f7-61b7587daf55 None None] MFA Rules not processed for user `4542138b7aa5446b8544dc766cbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:07.262003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bc79b413-c177-4948-b1f7-61b7587daf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:07.271057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1071/2126] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:14.109645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=28 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:14.996764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7a09-509c-4a68-ac9b-ed5fbc6e44aa None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:14.997043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7a09-509c-4a68-ac9b-ed5fbc6e44aa None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:14.997313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7a09-509c-4a68-ac9b-ed5fbc6e44aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:15.017181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ca4d7a09-509c-4a68-ac9b-ed5fbc6e44aa None None] MFA Rules not processed for user `827e8de6dbf84bdd809a359b5bf5a6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:15.019468 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ca4d7a09-509c-4a68-ac9b-ed5fbc6e44aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:15.077177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1056/2127] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:17.253687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=16 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:25.070321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=25 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:34.034993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79b413-c177-4948-b1f7-61b7587daf55 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:34.036651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bc79b413-c177-4948-b1f7-61b7587daf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:34.051895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79b413-c177-4948-b1f7-61b7587daf55 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:34.056964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:34.057600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:34.057874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:34.058144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] PATH_INFO: `/v3/users/ce10b9c62eea4f0e976c6723a7e081ab` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:34.059321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce10b9c62eea4f0e976c6723a7e081ab)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:34.061326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:34.219412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce10b9c62eea4f0e976c6723a7e081ab'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:34.226445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce10b9c62eea4f0e976c6723a7e081ab'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:34.313447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce10b9c62eea4f0e976c6723a7e081ab'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:34.314066 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce10b9c62eea4f0e976c6723a7e081ab'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:34.326737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce10b9c62eea4f0e976c6723a7e081ab'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:34.332594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1072/2128] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:43:34 2022] DELETE /identity/v3/users/ce10b9c62eea4f0e976c6723a7e081ab => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:34.337039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d39b1a-583c-470e-b81a-9d4e0e508e13 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:34.337507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d39b1a-583c-470e-b81a-9d4e0e508e13 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:34.337630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d39b1a-583c-470e-b81a-9d4e0e508e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:34.355875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-73d39b1a-583c-470e-b81a-9d4e0e508e13 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:34.357035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-73d39b1a-583c-470e-b81a-9d4e0e508e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:34.413978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1057/2129] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:34.423747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:34.425248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:34.490380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88dc78-8aac-4a5c-8a4c-21c2960a810e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:34.494161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d892ad9-62c3-4ce6-a6c0-e87f70f1be86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:34.494920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892ad9-62c3-4ce6-a6c0-e87f70f1be86 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:34.495269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892ad9-62c3-4ce6-a6c0-e87f70f1be86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:34.495605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892ad9-62c3-4ce6-a6c0-e87f70f1be86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:34.507728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d892ad9-62c3-4ce6-a6c0-e87f70f1be86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:34.509209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d892ad9-62c3-4ce6-a6c0-e87f70f1be86 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:34.522246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1073/2130] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:43:35.106198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d39b1a-583c-470e-b81a-9d4e0e508e13 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:35.107697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-73d39b1a-583c-470e-b81a-9d4e0e508e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:35.120787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d39b1a-583c-470e-b81a-9d4e0e508e13 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:35.126338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:35.127070 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.127563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.127900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] PATH_INFO: `/v3/projects/f490832d8b71427badbc78ae5eaa067e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.129113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f490832d8b71427badbc78ae5eaa067e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:35.131367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:35.256081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f490832d8b71427badbc78ae5eaa067e', 'request_id': 'req-2046279d-409b-4854-868b-3382363ad9e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:35.355530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f490832d8b71427badbc78ae5eaa067e', 'request_id': 'req-2046279d-409b-4854-868b-3382363ad9e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:35.362285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f490832d8b71427badbc78ae5eaa067e', 'request_id': 'req-2046279d-409b-4854-868b-3382363ad9e0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:35.372840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] The token cache is being invalidate because project f490832d8b71427badbc78ae5eaa067e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:43:35.373126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:35.373769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2046279d-409b-4854-868b-3382363ad9e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:35.375528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1058/2131] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:43:35 2022] DELETE /identity/v3/projects/f490832d8b71427badbc78ae5eaa067e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:35.380720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e55b-41eb-40c3-85fd-1d59c9a82568 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.381172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e55b-41eb-40c3-85fd-1d59c9a82568 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.381263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e55b-41eb-40c3-85fd-1d59c9a82568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.401761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-c389e55b-41eb-40c3-85fd-1d59c9a82568 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:35.402974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c389e55b-41eb-40c3-85fd-1d59c9a82568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:35.459703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1074/2132] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:35.467989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb9d7-fabb-4f0b-8e38-d183471e366a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.468278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb9d7-fabb-4f0b-8e38-d183471e366a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.468555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb9d7-fabb-4f0b-8e38-d183471e366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.487656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-db2bb9d7-fabb-4f0b-8e38-d183471e366a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:35.488855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db2bb9d7-fabb-4f0b-8e38-d183471e366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:35.496673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1059/2133] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:35.500840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389e55b-41eb-40c3-85fd-1d59c9a82568 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:35.510892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389e55b-41eb-40c3-85fd-1d59c9a82568 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:35.515439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:35.516019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.516295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.516566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.517209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:43:35.517518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:35.519136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:35.530924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1075/2134] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:43:35.535423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb9d7-fabb-4f0b-8e38-d183471e366a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:35.544473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb9d7-fabb-4f0b-8e38-d183471e366a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:35.549168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab08b5-dfb6-4b1b-b86a-bbd84f51d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:35.549752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab08b5-dfb6-4b1b-b86a-bbd84f51d9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.550032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab08b5-dfb6-4b1b-b86a-bbd84f51d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.550301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab08b5-dfb6-4b1b-b86a-bbd84f51d9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.551478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab08b5-dfb6-4b1b-b86a-bbd84f51d9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:35.553361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab08b5-dfb6-4b1b-b86a-bbd84f51d9e5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:35.634917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1060/2135] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:43:35 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:43:35.638887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:35.643968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:35.649611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44cba-d78b-4d65-9da7-6844de54aac6 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:35.706610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1f7d3-7f14-4e28-9831-b60a10ac5b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:35.707180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f7d3-7f14-4e28-9831-b60a10ac5b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.707454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f7d3-7f14-4e28-9831-b60a10ac5b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.707721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f7d3-7f14-4e28-9831-b60a10ac5b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.708352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1f7d3-7f14-4e28-9831-b60a10ac5b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:35.710241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1f7d3-7f14-4e28-9831-b60a10ac5b0b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:35.824931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1076/2136] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:43:35 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:43:35.834446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab08b5-dfb6-4b1b-b86a-bbd84f51d9e5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:35.844797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab08b5-dfb6-4b1b-b86a-bbd84f51d9e5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:35.849896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5dcff-79a0-42d4-aa03-6f7b3059062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:35.850519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5dcff-79a0-42d4-aa03-6f7b3059062b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.850802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5dcff-79a0-42d4-aa03-6f7b3059062b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.851074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5dcff-79a0-42d4-aa03-6f7b3059062b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.851715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5dcff-79a0-42d4-aa03-6f7b3059062b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:35.853325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5dcff-79a0-42d4-aa03-6f7b3059062b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:35.864286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1061/2137] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:43:35.868517 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1f7d3-7f14-4e28-9831-b60a10ac5b0b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:35.879786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1f7d3-7f14-4e28-9831-b60a10ac5b0b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:35.884666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34138ac-9256-48c7-b669-d7c55e9e9bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:35.885344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34138ac-9256-48c7-b669-d7c55e9e9bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.885567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34138ac-9256-48c7-b669-d7c55e9e9bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.885838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34138ac-9256-48c7-b669-d7c55e9e9bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.886525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34138ac-9256-48c7-b669-d7c55e9e9bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:35.888157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34138ac-9256-48c7-b669-d7c55e9e9bfb admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:35.899216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1077/2138] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:43:35.903372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5dcff-79a0-42d4-aa03-6f7b3059062b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:35.914367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5dcff-79a0-42d4-aa03-6f7b3059062b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:35.919445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:35.920098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:35.920372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:35.920646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] PATH_INFO: `/v3/projects/deb62d42c43140c9b887529430ad30dd/users/343bc074eec94b019ae8899acdba29e6/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:35.938177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb62d42c43140c9b887529430ad30dd, user_id=343bc074eec94b019ae8899acdba29e6, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:35.944089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:36.030929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1062/2139] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:43:35 2022] PUT /identity/v3/projects/deb62d42c43140c9b887529430ad30dd/users/343bc074eec94b019ae8899acdba29e6/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:36.033755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e6c-ae7b-4647-aef2-c1fe685b8e88 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:36.033755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e6c-ae7b-4647-aef2-c1fe685b8e88 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:36.033755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e6c-ae7b-4647-aef2-c1fe685b8e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:36.061440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-dade1e6c-ae7b-4647-aef2-c1fe685b8e88 None None] MFA Rules not processed for user `343bc074eec94b019ae8899acdba29e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:36.062681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-dade1e6c-ae7b-4647-aef2-c1fe685b8e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:36.127274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1078/2140] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:36.139654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:36.141377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:36.164022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:36.201402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c77d-f0d6-4534-96e3-d253198d676b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:36.205297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ba4aa-26e2-4d94-990b-6c753f3fcf0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:36.205940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba4aa-26e2-4d94-990b-6c753f3fcf0a service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:36.206214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba4aa-26e2-4d94-990b-6c753f3fcf0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:36.206503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ba4aa-26e2-4d94-990b-6c753f3fcf0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:36.216685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ba4aa-26e2-4d94-990b-6c753f3fcf0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:36.218122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ba4aa-26e2-4d94-990b-6c753f3fcf0a service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:36.226858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1063/2141] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:43:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:43:36.253212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1e6c-ae7b-4647-aef2-c1fe685b8e88 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:36.325336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1e6c-ae7b-4647-aef2-c1fe685b8e88 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:36.329913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:36.330565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:36.330845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:36.331115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] PATH_INFO: `/v3/users/343bc074eec94b019ae8899acdba29e6` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:36.332903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343bc074eec94b019ae8899acdba29e6)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:36.334857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:36.348912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:36.553642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343bc074eec94b019ae8899acdba29e6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:36.561120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343bc074eec94b019ae8899acdba29e6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:36.635851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343bc074eec94b019ae8899acdba29e6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:36.636512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343bc074eec94b019ae8899acdba29e6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:36.649882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343bc074eec94b019ae8899acdba29e6'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:36.655919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1079/2142] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:43:36 2022] DELETE /identity/v3/users/343bc074eec94b019ae8899acdba29e6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:36.662559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30b18-caa1-424c-ad3b-80e728837d28 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:36.662559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30b18-caa1-424c-ad3b-80e728837d28 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:36.662559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30b18-caa1-424c-ad3b-80e728837d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:36.680406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e4d30b18-caa1-424c-ad3b-80e728837d28 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:36.681539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e4d30b18-caa1-424c-ad3b-80e728837d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:36.739513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1064/2143] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:36.749906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:36.751386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:36.810645 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3816-b940-4097-9e1c-0e1d15c24f43 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:36.814181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:36.814808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:36.815084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:36.815355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:36.824706 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:36.826116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:36.838809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1080/2144] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:43:37.339238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30b18-caa1-424c-ad3b-80e728837d28 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:37.340743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e4d30b18-caa1-424c-ad3b-80e728837d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:37.356758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30b18-caa1-424c-ad3b-80e728837d28 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:37.361556 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:37.362191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:37.362484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:37.362773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] PATH_INFO: `/v3/projects/deb62d42c43140c9b887529430ad30dd` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:37.364190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb62d42c43140c9b887529430ad30dd)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:37.367151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:37.463911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb62d42c43140c9b887529430ad30dd', 'request_id': 'req-9f2771e2-8298-4699-aa8b-64207573d3c4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:37.527160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb62d42c43140c9b887529430ad30dd', 'request_id': 'req-9f2771e2-8298-4699-aa8b-64207573d3c4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:37.534208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb62d42c43140c9b887529430ad30dd', 'request_id': 'req-9f2771e2-8298-4699-aa8b-64207573d3c4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:37.545926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] The token cache is being invalidate because project deb62d42c43140c9b887529430ad30dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:43:37.546206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:37.546871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9f2771e2-8298-4699-aa8b-64207573d3c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:37.548378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1065/2145] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:43:37 2022] DELETE /identity/v3/projects/deb62d42c43140c9b887529430ad30dd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:46.833482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:47.543051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:48.455093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:48.456070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:48.470796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed749e2-e741-40c5-a211-17a75fa1172b service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:48.546695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:48.547340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:48.547622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:48.547881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] PATH_INFO: `/v3/users/d10f2062e8a24168904ee08c8e4a5f1b` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:48.549029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10f2062e8a24168904ee08c8e4a5f1b)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:48.551547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:48.821216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10f2062e8a24168904ee08c8e4a5f1b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:48.827912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10f2062e8a24168904ee08c8e4a5f1b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:48.915615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10f2062e8a24168904ee08c8e4a5f1b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:48.916250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10f2062e8a24168904ee08c8e4a5f1b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:48.930174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10f2062e8a24168904ee08c8e4a5f1b'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:48.936315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1081/2146] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:43:48 2022] DELETE /identity/v3/users/d10f2062e8a24168904ee08c8e4a5f1b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:48.940757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a971-bf95-45ad-94fb-11e9ed12e159 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:48.941219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a971-bf95-45ad-94fb-11e9ed12e159 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:48.943251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a971-bf95-45ad-94fb-11e9ed12e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:48.960052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9c29a971-bf95-45ad-94fb-11e9ed12e159 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:48.961280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9c29a971-bf95-45ad-94fb-11e9ed12e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:49.026145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1066/2147] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:43:49.039690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:49.041189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:49.107174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9d2ef-10a0-45a0-bf0f-a778ffbc9f62 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:49.113670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97bfbb-5d93-4d64-be4e-d2f26e866555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:49.115070 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97bfbb-5d93-4d64-be4e-d2f26e866555 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:49.115349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97bfbb-5d93-4d64-be4e-d2f26e866555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:49.115616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97bfbb-5d93-4d64-be4e-d2f26e866555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:49.125691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97bfbb-5d93-4d64-be4e-d2f26e866555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:49.127116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97bfbb-5d93-4d64-be4e-d2f26e866555 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:49.137093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1082/2148] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:43:49.614304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a971-bf95-45ad-94fb-11e9ed12e159 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:49.615763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9c29a971-bf95-45ad-94fb-11e9ed12e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:49.631107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a971-bf95-45ad-94fb-11e9ed12e159 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:49.636615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:49.637259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:49.637542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:49.637897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] PATH_INFO: `/v3/projects/3935cb6cb9d74e22ac777acadc894707` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:49.639079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3935cb6cb9d74e22ac777acadc894707)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:49.641021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:49.790116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3935cb6cb9d74e22ac777acadc894707', 'request_id': 'req-31aa5a31-b014-481f-ae6f-796ea505f115'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:49.878818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3935cb6cb9d74e22ac777acadc894707', 'request_id': 'req-31aa5a31-b014-481f-ae6f-796ea505f115'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:49.885366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3935cb6cb9d74e22ac777acadc894707', 'request_id': 'req-31aa5a31-b014-481f-ae6f-796ea505f115'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:49.896130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] The token cache is being invalidate because project 3935cb6cb9d74e22ac777acadc894707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:43:49.896418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:49.897047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-31aa5a31-b014-481f-ae6f-796ea505f115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:43:49.898595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1067/2149] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:43:49 2022] DELETE /identity/v3/projects/3935cb6cb9d74e22ac777acadc894707 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:49.903616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c5fc-7a37-4c44-b1ea-f80617230638 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:49.904200 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c5fc-7a37-4c44-b1ea-f80617230638 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:49.904200 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c5fc-7a37-4c44-b1ea-f80617230638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:49.925252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-33c2c5fc-7a37-4c44-b1ea-f80617230638 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:49.926460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-33c2c5fc-7a37-4c44-b1ea-f80617230638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:49.943221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:49.985085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1083/2150] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:49.992679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c02bd-556a-4159-a93c-c778b2977b2d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:49.993151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c02bd-556a-4159-a93c-c778b2977b2d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:49.993253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c02bd-556a-4159-a93c-c778b2977b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.014003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-015c02bd-556a-4159-a93c-c778b2977b2d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:50.014003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-015c02bd-556a-4159-a93c-c778b2977b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:50.022264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1068/2151] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:50.026566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c5fc-7a37-4c44-b1ea-f80617230638 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:50.037735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c5fc-7a37-4c44-b1ea-f80617230638 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:50.042332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:50.042958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:50.043229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:50.043495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.044140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:43:50.044433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:50.045999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:50.057244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1084/2152] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:43:50.061695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c02bd-556a-4159-a93c-c778b2977b2d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:50.070732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c02bd-556a-4159-a93c-c778b2977b2d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:50.075327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b059ecd-f83d-41d3-ad2c-b6d031056a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:50.075914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b059ecd-f83d-41d3-ad2c-b6d031056a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:50.076184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b059ecd-f83d-41d3-ad2c-b6d031056a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:50.076446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b059ecd-f83d-41d3-ad2c-b6d031056a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.077054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b059ecd-f83d-41d3-ad2c-b6d031056a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:50.078961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b059ecd-f83d-41d3-ad2c-b6d031056a88 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:50.174079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1069/2153] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:43:50 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:43:50.178578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:50.188422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4ea0-8f67-45f8-b311-c623afeccd26 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:50.243948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b819b9-16b9-4e80-8df3-4eafc1cc9e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:50.244542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b819b9-16b9-4e80-8df3-4eafc1cc9e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:50.244823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b819b9-16b9-4e80-8df3-4eafc1cc9e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:50.245092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b819b9-16b9-4e80-8df3-4eafc1cc9e5f admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.245712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b819b9-16b9-4e80-8df3-4eafc1cc9e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:50.247673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b819b9-16b9-4e80-8df3-4eafc1cc9e5f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:50.338823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1085/2154] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:43:50 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:43:50.343174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b059ecd-f83d-41d3-ad2c-b6d031056a88 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:50.353468 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b059ecd-f83d-41d3-ad2c-b6d031056a88 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:50.358205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309019c-d1dd-4efe-8d38-dc1adb8bd255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:50.360298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309019c-d1dd-4efe-8d38-dc1adb8bd255 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:50.360298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309019c-d1dd-4efe-8d38-dc1adb8bd255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:50.360298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309019c-d1dd-4efe-8d38-dc1adb8bd255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.360298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309019c-d1dd-4efe-8d38-dc1adb8bd255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:50.361734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309019c-d1dd-4efe-8d38-dc1adb8bd255 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:50.371560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1070/2155] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:43:50.375454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b819b9-16b9-4e80-8df3-4eafc1cc9e5f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:50.387166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b819b9-16b9-4e80-8df3-4eafc1cc9e5f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:50.390377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28c830-8d9f-4877-893e-02681d21bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:50.390998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28c830-8d9f-4877-893e-02681d21bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:50.391277 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28c830-8d9f-4877-893e-02681d21bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:50.391548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28c830-8d9f-4877-893e-02681d21bdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.392189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28c830-8d9f-4877-893e-02681d21bdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:50.393809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28c830-8d9f-4877-893e-02681d21bdbf admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:50.405091 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1086/2156] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:43:50.409413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309019c-d1dd-4efe-8d38-dc1adb8bd255 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:50.419173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309019c-d1dd-4efe-8d38-dc1adb8bd255 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:50.423736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:50.424416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:50.424635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:50.424899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] PATH_INFO: `/v3/projects/970da6acbc464dee8191789eec7ba844/users/12404366fbba4d1dbb554dcfe65c34d9/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.438837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=970da6acbc464dee8191789eec7ba844, user_id=12404366fbba4d1dbb554dcfe65c34d9, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:50.441987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:50.530251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1071/2157] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:43:50 2022] PUT /identity/v3/projects/970da6acbc464dee8191789eec7ba844/users/12404366fbba4d1dbb554dcfe65c34d9/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:50.535557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777083-8d94-41e6-8da7-a74f54ce8843 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:50.535840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777083-8d94-41e6-8da7-a74f54ce8843 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:50.536110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777083-8d94-41e6-8da7-a74f54ce8843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.554880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-aa777083-8d94-41e6-8da7-a74f54ce8843 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:50.556057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-aa777083-8d94-41e6-8da7-a74f54ce8843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:50.623818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1087/2158] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:50.634142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:50.636137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:50.660465 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:50.695505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eff20d-4e7e-4d27-a895-76fef0a2a6fd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:50.699049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e83445-e1e0-4be2-a0a2-f6c02bba0547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:50.699642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e83445-e1e0-4be2-a0a2-f6c02bba0547 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:50.699914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e83445-e1e0-4be2-a0a2-f6c02bba0547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:50.700177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e83445-e1e0-4be2-a0a2-f6c02bba0547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:50.709347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e83445-e1e0-4be2-a0a2-f6c02bba0547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:50.710816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e83445-e1e0-4be2-a0a2-f6c02bba0547 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:50.720098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1072/2159] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:43:53.721489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24268e4-ea60-4d69-bd86-a488eb98145e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:53.722143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24268e4-ea60-4d69-bd86-a488eb98145e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:53.722245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24268e4-ea60-4d69-bd86-a488eb98145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:53.744205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d24268e4-ea60-4d69-bd86-a488eb98145e None None] MFA Rules not processed for user `d28b7a7b2e0143cf9ee6e761eb7fb281`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:53.745962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d24268e4-ea60-4d69-bd86-a488eb98145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:53.789797 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:53.847709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1088/2160] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:56.458972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625f7d8-f400-4093-ba35-e259525942f4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:56.459846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625f7d8-f400-4093-ba35-e259525942f4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:56.461763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625f7d8-f400-4093-ba35-e259525942f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:56.507047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f625f7d8-f400-4093-ba35-e259525942f4 None None] MFA Rules not processed for user `12404366fbba4d1dbb554dcfe65c34d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:56.508389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f625f7d8-f400-4093-ba35-e259525942f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:56.593440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24268e4-ea60-4d69-bd86-a488eb98145e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:56.600417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1073/2161] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:56.606874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24268e4-ea60-4d69-bd86-a488eb98145e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:56.612307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0357d7-8695-43ab-be65-b9d787a54efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:56.613689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0357d7-8695-43ab-be65-b9d787a54efc admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:56.614039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0357d7-8695-43ab-be65-b9d787a54efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:56.614575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0357d7-8695-43ab-be65-b9d787a54efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:56.615341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0357d7-8695-43ab-be65-b9d787a54efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:56.617614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0357d7-8695-43ab-be65-b9d787a54efc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:56.729116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1089/2162] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:43:56 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:43:56.732580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625f7d8-f400-4093-ba35-e259525942f4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:56.745802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625f7d8-f400-4093-ba35-e259525942f4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:56.809237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3cb2-7f48-4cd9-9d5b-13ad3ac51037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:56.809976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3cb2-7f48-4cd9-9d5b-13ad3ac51037 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:56.810331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3cb2-7f48-4cd9-9d5b-13ad3ac51037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:56.810736 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3cb2-7f48-4cd9-9d5b-13ad3ac51037 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:56.811614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3cb2-7f48-4cd9-9d5b-13ad3ac51037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:56.813654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3cb2-7f48-4cd9-9d5b-13ad3ac51037 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:56.904637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1074/2163] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:43:56 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:43:56.908841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0357d7-8695-43ab-be65-b9d787a54efc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:56.919539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0357d7-8695-43ab-be65-b9d787a54efc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:56.924067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2121a-7d0c-4e32-8e7d-576f414b41d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:56.924689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2121a-7d0c-4e32-8e7d-576f414b41d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:56.924986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2121a-7d0c-4e32-8e7d-576f414b41d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:56.925802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2121a-7d0c-4e32-8e7d-576f414b41d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:56.926443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2121a-7d0c-4e32-8e7d-576f414b41d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:56.928065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2121a-7d0c-4e32-8e7d-576f414b41d7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:56.938208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1090/2164] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:43:56.942430 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3cb2-7f48-4cd9-9d5b-13ad3ac51037 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:56.952839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3cb2-7f48-4cd9-9d5b-13ad3ac51037 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:56.957841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74ce39-bc22-48d4-a142-685a2de73e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:56.958554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74ce39-bc22-48d4-a142-685a2de73e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:56.958811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74ce39-bc22-48d4-a142-685a2de73e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:56.959077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74ce39-bc22-48d4-a142-685a2de73e66 admin admin] PATH_INFO: `/v3/projects/b3929184dbc34d198e60fbcb19331ebb/users/c1a1dfb504da496db9691d11f8bbb4aa/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:56.974508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74ce39-bc22-48d4-a142-685a2de73e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3929184dbc34d198e60fbcb19331ebb, user_id=c1a1dfb504da496db9691d11f8bbb4aa, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:56.977137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74ce39-bc22-48d4-a142-685a2de73e66 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:57.050907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1075/2165] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:43:56 2022] PUT /identity/v3/projects/b3929184dbc34d198e60fbcb19331ebb/users/c1a1dfb504da496db9691d11f8bbb4aa/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:57.054753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2121a-7d0c-4e32-8e7d-576f414b41d7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:57.064594 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2121a-7d0c-4e32-8e7d-576f414b41d7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:57.127216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd4597-b56b-4680-a303-a5a7c781a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:57.127822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4597-b56b-4680-a303-a5a7c781a03a admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:57.128096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4597-b56b-4680-a303-a5a7c781a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:57.128392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4597-b56b-4680-a303-a5a7c781a03a admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:57.129032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4597-b56b-4680-a303-a5a7c781a03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:57.130643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4597-b56b-4680-a303-a5a7c781a03a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:57.140964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1091/2166] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:43:57.145041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74ce39-bc22-48d4-a142-685a2de73e66 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:57.155516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74ce39-bc22-48d4-a142-685a2de73e66 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:57.161148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:57.161795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:57.162071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:57.162342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] PATH_INFO: `/v3/projects/b3929184dbc34d198e60fbcb19331ebb/users/c1a1dfb504da496db9691d11f8bbb4aa/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:57.164331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3929184dbc34d198e60fbcb19331ebb, user_id=c1a1dfb504da496db9691d11f8bbb4aa, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:57.167009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:57.178202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1076/2167] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:43:57 2022] PUT /identity/v3/projects/b3929184dbc34d198e60fbcb19331ebb/users/c1a1dfb504da496db9691d11f8bbb4aa/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:43:57.661635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b9f2-285e-4515-9354-36321c0a0dbd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:57.662660 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b9f2-285e-4515-9354-36321c0a0dbd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:57.662952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b9f2-285e-4515-9354-36321c0a0dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:57.685853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a4d4b9f2-285e-4515-9354-36321c0a0dbd None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:43:57.687119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a4d4b9f2-285e-4515-9354-36321c0a0dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:57.765122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1092/2168] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:43:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:43:57.806937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:43:57.809186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:43:57.816741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:57.880757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c48d2-4ef7-48a6-a7c0-743c14570f84 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:43:57.885855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:43:57.886489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:43:57.886765 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:43:57.887031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:43:57.910369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:43:57.912069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:43:57.951044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1077/2169] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:43:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:44:05.927365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5086-5710-4a02-a01e-bb51195c5589 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:05.927365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5086-5710-4a02-a01e-bb51195c5589 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:05.927365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5086-5710-4a02-a01e-bb51195c5589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:05.986123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-720c5086-5710-4a02-a01e-bb51195c5589 None None] MFA Rules not processed for user `c1a1dfb504da496db9691d11f8bbb4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:05.987747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-720c5086-5710-4a02-a01e-bb51195c5589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:06.036174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:06.101335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1093/2170] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:06.118450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:06.120118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:06.199561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f8a8e-873f-44e3-a2e1-0811c8225455 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:06.204792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b2f5-fe83-4122-b0c1-54c876e6a042 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb458a6186814aadb4ef178ff199582c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:06.205496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b2f5-fe83-4122-b0c1-54c876e6a042 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:06.205817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b2f5-fe83-4122-b0c1-54c876e6a042 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:06.206236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b2f5-fe83-4122-b0c1-54c876e6a042 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:06.285831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b2f5-fe83-4122-b0c1-54c876e6a042 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:06.287544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b2f5-fe83-4122-b0c1-54c876e6a042 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:06.301147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1078/2171] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:44:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:44:07.162072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdbf97-6a9d-415a-992d-ab29756af749 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:07.162072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdbf97-6a9d-415a-992d-ab29756af749 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:07.162072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdbf97-6a9d-415a-992d-ab29756af749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:07.181651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-46bdbf97-6a9d-415a-992d-ab29756af749 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:07.183220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-46bdbf97-6a9d-415a-992d-ab29756af749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:07.192375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1094/2172] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:07.214045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b2f5-fe83-4122-b0c1-54c876e6a042 service glance] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:07.232438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b2f5-fe83-4122-b0c1-54c876e6a042 service glance] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:07.238242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b26f5-b994-4ccf-8795-23b098ff63ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:07.238962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b26f5-b994-4ccf-8795-23b098ff63ed service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:07.239310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b26f5-b994-4ccf-8795-23b098ff63ed service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:07.239650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b26f5-b994-4ccf-8795-23b098ff63ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:07.249658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b26f5-b994-4ccf-8795-23b098ff63ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:07.251762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b26f5-b994-4ccf-8795-23b098ff63ed service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:07.264248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1079/2173] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:44:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:44:17.175798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=18 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:17.260200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:20.945371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691026-22db-4101-9ad6-a1832751aaaa None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:20.945932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691026-22db-4101-9ad6-a1832751aaaa None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:20.945932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691026-22db-4101-9ad6-a1832751aaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:20.964559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bc691026-22db-4101-9ad6-a1832751aaaa None None] MFA Rules not processed for user `12404366fbba4d1dbb554dcfe65c34d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:20.965739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bc691026-22db-4101-9ad6-a1832751aaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:20.972583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1095/2174] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:21.931605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd163-9516-463f-af2e-f12994f6e733 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:21.932125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd163-9516-463f-af2e-f12994f6e733 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:21.932125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd163-9516-463f-af2e-f12994f6e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:21.953288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-443bd163-9516-463f-af2e-f12994f6e733 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:21.954496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-443bd163-9516-463f-af2e-f12994f6e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:21.961641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1080/2175] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 10 08:44:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:21.975740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc691026-22db-4101-9ad6-a1832751aaaa None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:21.986630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc691026-22db-4101-9ad6-a1832751aaaa None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:21.992055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531558-601c-4c78-b3c8-c8ff7da4f1c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:21.992639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531558-601c-4c78-b3c8-c8ff7da4f1c1 service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:21.992913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531558-601c-4c78-b3c8-c8ff7da4f1c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:21.993179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531558-601c-4c78-b3c8-c8ff7da4f1c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:22.001449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13531558-601c-4c78-b3c8-c8ff7da4f1c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:22.003099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13531558-601c-4c78-b3c8-c8ff7da4f1c1 service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:22.011096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1096/2176] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:44:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:44:24.694292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66a70-0854-43ff-966c-bf1141735d08 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:24.695188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66a70-0854-43ff-966c-bf1141735d08 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:24.695463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66a70-0854-43ff-966c-bf1141735d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:24.715106 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6ff66a70-0854-43ff-966c-bf1141735d08 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:24.716220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6ff66a70-0854-43ff-966c-bf1141735d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:24.724989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1081/2177] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:44:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:24.739476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531558-601c-4c78-b3c8-c8ff7da4f1c1 service swift] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:24.751064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531558-601c-4c78-b3c8-c8ff7da4f1c1 service swift] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:24.756651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94d23-99f3-47a0-a2bf-245f346925ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:24.767610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94d23-99f3-47a0-a2bf-245f346925ed service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:24.767610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94d23-99f3-47a0-a2bf-245f346925ed service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:24.767610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94d23-99f3-47a0-a2bf-245f346925ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:24.767610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c94d23-99f3-47a0-a2bf-245f346925ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:24.767989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c94d23-99f3-47a0-a2bf-245f346925ed service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:24.775628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1097/2178] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:44:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:44:25.440825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e76f3-1525-40dc-b9db-fdc35bfafba1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:25.440825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e76f3-1525-40dc-b9db-fdc35bfafba1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:25.440825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e76f3-1525-40dc-b9db-fdc35bfafba1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:25.442314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1082/2179] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:44:25.447992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9feb8e-a450-4d1f-9edc-37f6d40396d7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:25.448323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9feb8e-a450-4d1f-9edc-37f6d40396d7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:25.450371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9feb8e-a450-4d1f-9edc-37f6d40396d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:25.471003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-5a9feb8e-a450-4d1f-9edc-37f6d40396d7 None None] MFA Rules not processed for user `f9f08c0a99674a849035dc0b44e62e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:25.472469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5a9feb8e-a450-4d1f-9edc-37f6d40396d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:25.545140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1098/2180] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:44:25.557032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e76f3-1525-40dc-b9db-fdc35bfafba1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:25.559196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-182e76f3-1525-40dc-b9db-fdc35bfafba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:25.584968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9feb8e-a450-4d1f-9edc-37f6d40396d7 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:25.586220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e76f3-1525-40dc-b9db-fdc35bfafba1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:25.586973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5a9feb8e-a450-4d1f-9edc-37f6d40396d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:25.591986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e9780-6143-42a7-951d-e48a3390a364 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:25.592859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9780-6143-42a7-951d-e48a3390a364 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:25.593325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9780-6143-42a7-951d-e48a3390a364 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:25.593795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9780-6143-42a7-951d-e48a3390a364 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:25.603718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e9780-6143-42a7-951d-e48a3390a364 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:25.605732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e9780-6143-42a7-951d-e48a3390a364 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:25.617496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1083/2181] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:44:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:44:25.681379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9feb8e-a450-4d1f-9edc-37f6d40396d7 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:25.685759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:25.686394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:25.686697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:25.686964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] PATH_INFO: `/v3/users/827e8de6dbf84bdd809a359b5bf5a6cf` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:25.688114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827e8de6dbf84bdd809a359b5bf5a6cf)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:25.690567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:25.878782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827e8de6dbf84bdd809a359b5bf5a6cf'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:25.885572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827e8de6dbf84bdd809a359b5bf5a6cf'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:25.972559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827e8de6dbf84bdd809a359b5bf5a6cf'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:25.973274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827e8de6dbf84bdd809a359b5bf5a6cf'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:25.975622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:25.986304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-40322cc3-6fb6-48f2-a7fb-95921f8e2ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827e8de6dbf84bdd809a359b5bf5a6cf'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:25.994185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1099/2182] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:44:25 2022] DELETE /identity/v3/users/827e8de6dbf84bdd809a359b5bf5a6cf => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:26.252566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e9780-6143-42a7-951d-e48a3390a364 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:26.263331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e9780-6143-42a7-951d-e48a3390a364 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:26.345288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:26.345925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:26.346205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:26.347204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] PATH_INFO: `/v3/projects/ca3946b4be044dc892d608672069c366` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:26.348355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3946b4be044dc892d608672069c366)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:26.350277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:26.457112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3946b4be044dc892d608672069c366', 'request_id': 'req-802f421c-9b82-4dd3-9190-9d804858ff86'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:26.563492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3946b4be044dc892d608672069c366', 'request_id': 'req-802f421c-9b82-4dd3-9190-9d804858ff86'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:26.570459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3946b4be044dc892d608672069c366', 'request_id': 'req-802f421c-9b82-4dd3-9190-9d804858ff86'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:26.582644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] The token cache is being invalidate because project ca3946b4be044dc892d608672069c366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:44:26.583041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:26.583766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-802f421c-9b82-4dd3-9190-9d804858ff86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:26.585287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1084/2183] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:44:26 2022] DELETE /identity/v3/projects/ca3946b4be044dc892d608672069c366 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:26.590095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520931-360b-4f9d-a780-fa11912653b0 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:26.590386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520931-360b-4f9d-a780-fa11912653b0 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:26.590696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520931-360b-4f9d-a780-fa11912653b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:26.610449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ca520931-360b-4f9d-a780-fa11912653b0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:26.611682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ca520931-360b-4f9d-a780-fa11912653b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:26.677577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1100/2184] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:26.685302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8931c-9de5-4bd1-b9ca-8d0461f68603 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:26.685578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8931c-9de5-4bd1-b9ca-8d0461f68603 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:26.685843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8931c-9de5-4bd1-b9ca-8d0461f68603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:26.709402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-edf8931c-9de5-4bd1-b9ca-8d0461f68603 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:26.711066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-edf8931c-9de5-4bd1-b9ca-8d0461f68603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:26.719982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1085/2185] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:26.724596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca520931-360b-4f9d-a780-fa11912653b0 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:26.734570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca520931-360b-4f9d-a780-fa11912653b0 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:26.739214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:26.739799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:26.740274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:26.740370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:26.740979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:44:26.741277 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:26.742911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:26.754214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1101/2186] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:44:26.758759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8931c-9de5-4bd1-b9ca-8d0461f68603 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:26.768679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8931c-9de5-4bd1-b9ca-8d0461f68603 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:26.773389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0a9b5-36d4-4b73-8905-a59fee22046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:26.773979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0a9b5-36d4-4b73-8905-a59fee22046e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:26.774260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0a9b5-36d4-4b73-8905-a59fee22046e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:26.774568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0a9b5-36d4-4b73-8905-a59fee22046e admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:26.775218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0a9b5-36d4-4b73-8905-a59fee22046e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:26.777118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0a9b5-36d4-4b73-8905-a59fee22046e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:26.859735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1086/2187] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:44:26 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:44:26.864098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:26.874011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2051e-f08b-4676-96a9-8b896e7e5481 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:26.927488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cb677-2bf8-4209-a938-34ff5b106703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:26.928145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb677-2bf8-4209-a938-34ff5b106703 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:26.928344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb677-2bf8-4209-a938-34ff5b106703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:26.928615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb677-2bf8-4209-a938-34ff5b106703 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:26.929227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cb677-2bf8-4209-a938-34ff5b106703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:26.931173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cb677-2bf8-4209-a938-34ff5b106703 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:27.084447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1102/2188] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:44:26 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:44:27.085562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0a9b5-36d4-4b73-8905-a59fee22046e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:27.100935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0a9b5-36d4-4b73-8905-a59fee22046e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:27.106413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3502f5-61e2-46f2-9bc7-9f5f73aca14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:27.107045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3502f5-61e2-46f2-9bc7-9f5f73aca14c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:27.107318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3502f5-61e2-46f2-9bc7-9f5f73aca14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:27.107582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3502f5-61e2-46f2-9bc7-9f5f73aca14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:27.108563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3502f5-61e2-46f2-9bc7-9f5f73aca14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:27.110147 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3502f5-61e2-46f2-9bc7-9f5f73aca14c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:27.121003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1087/2189] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:44:27.125158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cb677-2bf8-4209-a938-34ff5b106703 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:27.135638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cb677-2bf8-4209-a938-34ff5b106703 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:27.140358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd7b7-a819-41d0-b976-775f6d62c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:27.140963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd7b7-a819-41d0-b976-775f6d62c300 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:27.141241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd7b7-a819-41d0-b976-775f6d62c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:27.141511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd7b7-a819-41d0-b976-775f6d62c300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:27.142158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfd7b7-a819-41d0-b976-775f6d62c300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:27.143884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfd7b7-a819-41d0-b976-775f6d62c300 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:27.164223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1103/2190] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:44:27.168427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3502f5-61e2-46f2-9bc7-9f5f73aca14c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:27.181215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3502f5-61e2-46f2-9bc7-9f5f73aca14c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:27.185784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:27.186424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:27.186737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:27.187009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] PATH_INFO: `/v3/projects/6bd9bb99409b4d29a960a6b00d225ef7/users/2514c532eca04cb59184b6f377138f93/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:27.200976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd9bb99409b4d29a960a6b00d225ef7, user_id=2514c532eca04cb59184b6f377138f93, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:27.203754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:27.262615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:27.267324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1088/2191] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:44:27 2022] PUT /identity/v3/projects/6bd9bb99409b4d29a960a6b00d225ef7/users/2514c532eca04cb59184b6f377138f93/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:27.278186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11abcd-3cbf-4481-83cd-eb129ed7de55 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:27.278494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11abcd-3cbf-4481-83cd-eb129ed7de55 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:27.278788 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11abcd-3cbf-4481-83cd-eb129ed7de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:27.311292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-5e11abcd-3cbf-4481-83cd-eb129ed7de55 None None] MFA Rules not processed for user `2514c532eca04cb59184b6f377138f93`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:27.312533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5e11abcd-3cbf-4481-83cd-eb129ed7de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:27.364428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:27.400895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1104/2192] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:44:27.412857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:27.414758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:27.480055 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351f2c-eca5-48f0-a585-9eaf056b1924 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:27.483947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20895ebc-4f30-48e9-86c4-70829bf71c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:27.484631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895ebc-4f30-48e9-86c4-70829bf71c62 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:27.484968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895ebc-4f30-48e9-86c4-70829bf71c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:27.485299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895ebc-4f30-48e9-86c4-70829bf71c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:27.494090 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20895ebc-4f30-48e9-86c4-70829bf71c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:27.495858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20895ebc-4f30-48e9-86c4-70829bf71c62 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:27.512192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1089/2193] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:44:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:44:37.495210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=10 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:37.505617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=26 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:42.564523 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11abcd-3cbf-4481-83cd-eb129ed7de55 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:42.640529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11abcd-3cbf-4481-83cd-eb129ed7de55 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:42.645536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:42.646028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:42.646307 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:42.646624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] PATH_INFO: `/v3/users/2514c532eca04cb59184b6f377138f93` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:42.647764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2514c532eca04cb59184b6f377138f93)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:42.649695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:42.841846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2514c532eca04cb59184b6f377138f93'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:42.851460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2514c532eca04cb59184b6f377138f93'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:42.923677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2514c532eca04cb59184b6f377138f93'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:42.924340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2514c532eca04cb59184b6f377138f93'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:42.946032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2514c532eca04cb59184b6f377138f93'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:42.956683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1105/2194] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:44:42 2022] DELETE /identity/v3/users/2514c532eca04cb59184b6f377138f93 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:42.958446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9bda2-c1c3-41d4-8747-6a7a75a569cc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:42.958922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9bda2-c1c3-41d4-8747-6a7a75a569cc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:42.959074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9bda2-c1c3-41d4-8747-6a7a75a569cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:42.978989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-38c9bda2-c1c3-41d4-8747-6a7a75a569cc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:42.980199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-38c9bda2-c1c3-41d4-8747-6a7a75a569cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:43.044098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1090/2195] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:43.054001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:43.055516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:43.114179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62abd-a869-46a3-bc06-e0093f9516a3 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:43.117750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e88d4e-3c29-4b7b-8c3b-1168b9034b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:43.118338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88d4e-3c29-4b7b-8c3b-1168b9034b9d service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:43.118644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88d4e-3c29-4b7b-8c3b-1168b9034b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:43.118909 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88d4e-3c29-4b7b-8c3b-1168b9034b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:43.127585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e88d4e-3c29-4b7b-8c3b-1168b9034b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:43.128989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e88d4e-3c29-4b7b-8c3b-1168b9034b9d service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:43.138595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1106/2196] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:44:43.604775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9bda2-c1c3-41d4-8747-6a7a75a569cc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:43.606283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-38c9bda2-c1c3-41d4-8747-6a7a75a569cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:43.620521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9bda2-c1c3-41d4-8747-6a7a75a569cc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:43.623941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:43.624631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:43.624905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:43.625222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] PATH_INFO: `/v3/projects/6bd9bb99409b4d29a960a6b00d225ef7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:43.626383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd9bb99409b4d29a960a6b00d225ef7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:43.628362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:43.812341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd9bb99409b4d29a960a6b00d225ef7', 'request_id': 'req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:43.922944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd9bb99409b4d29a960a6b00d225ef7', 'request_id': 'req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:43.930903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd9bb99409b4d29a960a6b00d225ef7', 'request_id': 'req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:43.941359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] The token cache is being invalidate because project 6bd9bb99409b4d29a960a6b00d225ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:44:43.941677 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:43.942843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-93cfdbab-d2ae-4f4c-8747-3ce3fa25b7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:43.944527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1091/2197] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:44:43 2022] DELETE /identity/v3/projects/6bd9bb99409b4d29a960a6b00d225ef7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:43.949145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5d5c-1d65-45d9-aa00-40b0734c8212 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:43.949566 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5d5c-1d65-45d9-aa00-40b0734c8212 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:43.949668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5d5c-1d65-45d9-aa00-40b0734c8212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:43.968913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-03fa5d5c-1d65-45d9-aa00-40b0734c8212 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:43.970115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-03fa5d5c-1d65-45d9-aa00-40b0734c8212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:43.986735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:44.028191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1107/2198] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:44.036118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe2da-1ff9-495b-a183-534622e59a17 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.036727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe2da-1ff9-495b-a183-534622e59a17 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.037233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe2da-1ff9-495b-a183-534622e59a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.057026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4a8fe2da-1ff9-495b-a183-534622e59a17 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:44.058233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4a8fe2da-1ff9-495b-a183-534622e59a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:44.066386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1092/2199] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:44.071319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa5d5c-1d65-45d9-aa00-40b0734c8212 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:44.081147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa5d5c-1d65-45d9-aa00-40b0734c8212 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:44.086328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:44.087044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.087297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.087567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.088241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:44:44.088541 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:44.090138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:44.102236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1108/2200] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:44:44.106631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fe2da-1ff9-495b-a183-534622e59a17 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:44.116222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fe2da-1ff9-495b-a183-534622e59a17 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:44.120853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf907c3-7efa-4b3d-976b-08ba4b8cdaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:44.121447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf907c3-7efa-4b3d-976b-08ba4b8cdaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.121717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf907c3-7efa-4b3d-976b-08ba4b8cdaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.121981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf907c3-7efa-4b3d-976b-08ba4b8cdaf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.122633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf907c3-7efa-4b3d-976b-08ba4b8cdaf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:44.124514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf907c3-7efa-4b3d-976b-08ba4b8cdaf9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:44.204438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1093/2201] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:44:44 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:44:44.208535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:44.218199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1326-fef4-4cc4-b8e5-09c1402e2bd5 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:44.272266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0e25b-ebd2-486a-8d2e-7b7f3173e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:44.272850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0e25b-ebd2-486a-8d2e-7b7f3173e132 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.273125 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0e25b-ebd2-486a-8d2e-7b7f3173e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.273391 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0e25b-ebd2-486a-8d2e-7b7f3173e132 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.274008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0e25b-ebd2-486a-8d2e-7b7f3173e132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:44.275924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0e25b-ebd2-486a-8d2e-7b7f3173e132 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:44.357509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1109/2202] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:44:44 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:44:44.360901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf907c3-7efa-4b3d-976b-08ba4b8cdaf9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:44.371883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf907c3-7efa-4b3d-976b-08ba4b8cdaf9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:44.377245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dcb2e-3f0f-4007-80be-b73701107a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:44.377245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dcb2e-3f0f-4007-80be-b73701107a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.377543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dcb2e-3f0f-4007-80be-b73701107a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.377648 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dcb2e-3f0f-4007-80be-b73701107a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.378231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dcb2e-3f0f-4007-80be-b73701107a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:44.379843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dcb2e-3f0f-4007-80be-b73701107a5a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:44.389571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1094/2203] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:44:44.393327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0e25b-ebd2-486a-8d2e-7b7f3173e132 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:44.403084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0e25b-ebd2-486a-8d2e-7b7f3173e132 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:44.407922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7280057-b245-46b9-a00b-9bc2daabc000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:44.408518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280057-b245-46b9-a00b-9bc2daabc000 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.408792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280057-b245-46b9-a00b-9bc2daabc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.409060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280057-b245-46b9-a00b-9bc2daabc000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.409692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7280057-b245-46b9-a00b-9bc2daabc000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:44.411766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7280057-b245-46b9-a00b-9bc2daabc000 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:44.421913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1110/2204] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:44:44.425920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dcb2e-3f0f-4007-80be-b73701107a5a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:44.436378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dcb2e-3f0f-4007-80be-b73701107a5a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:44.441036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:44.441687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.441963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.442233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] PATH_INFO: `/v3/projects/4b1eabd6a6824ffcb1bbbdc93c46649d/users/6fbc0adc592b495885768a1f8932cbd2/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.456635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1eabd6a6824ffcb1bbbdc93c46649d, user_id=6fbc0adc592b495885768a1f8932cbd2, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:44.459342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:44.567868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1095/2205] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:44:44 2022] PUT /identity/v3/projects/4b1eabd6a6824ffcb1bbbdc93c46649d/users/6fbc0adc592b495885768a1f8932cbd2/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:44.580202 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281bd26-8144-4c07-a2f8-3b246dd5380e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.580486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281bd26-8144-4c07-a2f8-3b246dd5380e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.580758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281bd26-8144-4c07-a2f8-3b246dd5380e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.610289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-b281bd26-8144-4c07-a2f8-3b246dd5380e None None] MFA Rules not processed for user `6fbc0adc592b495885768a1f8932cbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:44.611538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b281bd26-8144-4c07-a2f8-3b246dd5380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:44.677051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1111/2206] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:44.688608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:44.690305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:44.713246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:44.747772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ade45-8798-4d77-8e94-55d9c75d92fa admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:44.751454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a955ac6-d2ae-4552-849b-3ea0651c7e53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:44.752050 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955ac6-d2ae-4552-849b-3ea0651c7e53 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:44.752327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955ac6-d2ae-4552-849b-3ea0651c7e53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:44.752597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955ac6-d2ae-4552-849b-3ea0651c7e53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:44.760878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a955ac6-d2ae-4552-849b-3ea0651c7e53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:44.762335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a955ac6-d2ae-4552-849b-3ea0651c7e53 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:44.771901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1096/2207] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:44:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:44:54.673920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:54.840481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=17 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:55.862436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281bd26-8144-4c07-a2f8-3b246dd5380e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:55.925127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281bd26-8144-4c07-a2f8-3b246dd5380e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:55.929610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:55.930229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:55.930532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:55.930799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] PATH_INFO: `/v3/users/6fbc0adc592b495885768a1f8932cbd2` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:55.931906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbc0adc592b495885768a1f8932cbd2)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:55.933825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:56.118671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbc0adc592b495885768a1f8932cbd2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:56.125509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbc0adc592b495885768a1f8932cbd2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:56.168006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbc0adc592b495885768a1f8932cbd2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:56.168616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbc0adc592b495885768a1f8932cbd2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:56.180268 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbc0adc592b495885768a1f8932cbd2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:56.186046 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1112/2208] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:44:55 2022] DELETE /identity/v3/users/6fbc0adc592b495885768a1f8932cbd2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:56.190600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafa66-29bf-4531-ab86-c3a32b78b9c8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:56.191088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafa66-29bf-4531-ab86-c3a32b78b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:56.191186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafa66-29bf-4531-ab86-c3a32b78b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:56.211186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-adcafa66-29bf-4531-ab86-c3a32b78b9c8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:56.212399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-adcafa66-29bf-4531-ab86-c3a32b78b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:56.268370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1097/2209] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:56.278540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:56.279947 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:56.339255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a9083-7a33-4934-8d3e-3a5879ff7815 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:56.342927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1484c25-fc50-42a2-b376-85da64a8be17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:56.343525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1484c25-fc50-42a2-b376-85da64a8be17 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:56.343803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1484c25-fc50-42a2-b376-85da64a8be17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:56.344071 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1484c25-fc50-42a2-b376-85da64a8be17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:56.352896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1484c25-fc50-42a2-b376-85da64a8be17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:56.354310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1484c25-fc50-42a2-b376-85da64a8be17 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:56.363582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1113/2210] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:44:56.827027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcafa66-29bf-4531-ab86-c3a32b78b9c8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:56.828522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-adcafa66-29bf-4531-ab86-c3a32b78b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:56.840257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcafa66-29bf-4531-ab86-c3a32b78b9c8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:56.845911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:56.846743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:56.847082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:56.847491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] PATH_INFO: `/v3/projects/4b1eabd6a6824ffcb1bbbdc93c46649d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:56.849296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1eabd6a6824ffcb1bbbdc93c46649d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:56.852125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:56.968292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1eabd6a6824ffcb1bbbdc93c46649d', 'request_id': 'req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:57.029206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1eabd6a6824ffcb1bbbdc93c46649d', 'request_id': 'req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:57.037288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1eabd6a6824ffcb1bbbdc93c46649d', 'request_id': 'req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:57.052066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] The token cache is being invalidate because project 4b1eabd6a6824ffcb1bbbdc93c46649d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:44:57.052415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:57.053134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e49b52e2-25ac-45bf-a4b0-8ed12b5364bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:44:57.054700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1098/2211] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:44:56 2022] DELETE /identity/v3/projects/4b1eabd6a6824ffcb1bbbdc93c46649d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:57.059669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228533-d0cf-417c-879a-86f6a65ddd7a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.060129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228533-d0cf-417c-879a-86f6a65ddd7a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.060219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228533-d0cf-417c-879a-86f6a65ddd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.079267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-be228533-d0cf-417c-879a-86f6a65ddd7a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:57.080463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-be228533-d0cf-417c-879a-86f6a65ddd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:57.096819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:57.138392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1114/2212] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:57.146583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8af0-4ccf-403d-92a8-890a3c255423 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.146865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8af0-4ccf-403d-92a8-890a3c255423 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.147139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8af0-4ccf-403d-92a8-890a3c255423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.168470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-769c8af0-4ccf-403d-92a8-890a3c255423 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:57.169730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-769c8af0-4ccf-403d-92a8-890a3c255423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:57.178209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1099/2213] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:57.182458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be228533-d0cf-417c-879a-86f6a65ddd7a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:57.192205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be228533-d0cf-417c-879a-86f6a65ddd7a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:57.196737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:57.197330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.197605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.198508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.198508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:44:57.198818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:57.200399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:57.211757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1115/2214] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:44:57.216094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c8af0-4ccf-403d-92a8-890a3c255423 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:57.226156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c8af0-4ccf-403d-92a8-890a3c255423 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:57.231086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7128b3-0ec8-4bc2-a8a2-190cd73f7d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:57.231682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7128b3-0ec8-4bc2-a8a2-190cd73f7d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.231961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7128b3-0ec8-4bc2-a8a2-190cd73f7d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.232237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7128b3-0ec8-4bc2-a8a2-190cd73f7d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.232875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7128b3-0ec8-4bc2-a8a2-190cd73f7d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:57.234816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7128b3-0ec8-4bc2-a8a2-190cd73f7d88 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:57.335821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1100/2215] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:44:57 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:44:57.339859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:57.354924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8168a3b-26c6-4f02-9310-1ea1920d5196 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:57.409026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7207-f0e1-4d3e-bc2f-16f7540e3796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:57.409618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7207-f0e1-4d3e-bc2f-16f7540e3796 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.409898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7207-f0e1-4d3e-bc2f-16f7540e3796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.410833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7207-f0e1-4d3e-bc2f-16f7540e3796 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.411459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7207-f0e1-4d3e-bc2f-16f7540e3796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:57.413402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7207-f0e1-4d3e-bc2f-16f7540e3796 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:57.488203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1116/2216] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:44:57 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:44:57.492350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7128b3-0ec8-4bc2-a8a2-190cd73f7d88 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:57.502533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7128b3-0ec8-4bc2-a8a2-190cd73f7d88 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:57.507080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dec6c0-0f93-4ccd-85c2-a298f2e5850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:57.507662 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec6c0-0f93-4ccd-85c2-a298f2e5850d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.507933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec6c0-0f93-4ccd-85c2-a298f2e5850d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.508196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dec6c0-0f93-4ccd-85c2-a298f2e5850d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.508830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dec6c0-0f93-4ccd-85c2-a298f2e5850d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:57.510387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dec6c0-0f93-4ccd-85c2-a298f2e5850d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:57.520500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1101/2217] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:44:57.524365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7207-f0e1-4d3e-bc2f-16f7540e3796 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:57.534573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7207-f0e1-4d3e-bc2f-16f7540e3796 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:57.539841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265ce3e-0871-430a-bb94-11b66ee5977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:57.540426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265ce3e-0871-430a-bb94-11b66ee5977e admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.540703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265ce3e-0871-430a-bb94-11b66ee5977e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.540973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265ce3e-0871-430a-bb94-11b66ee5977e admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.541609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265ce3e-0871-430a-bb94-11b66ee5977e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:57.543234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265ce3e-0871-430a-bb94-11b66ee5977e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:57.553577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1117/2218] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:44:57.557523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dec6c0-0f93-4ccd-85c2-a298f2e5850d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:57.567324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dec6c0-0f93-4ccd-85c2-a298f2e5850d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:57.571983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:57.572618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.572892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.573161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] PATH_INFO: `/v3/projects/b3230d51d63a4f9a9d47624c553242f4/users/f1c7a90e90e5411f92eddd180ef9e27d/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.587952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3230d51d63a4f9a9d47624c553242f4, user_id=f1c7a90e90e5411f92eddd180ef9e27d, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:57.590613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:57.664723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1102/2219] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:44:57 2022] PUT /identity/v3/projects/b3230d51d63a4f9a9d47624c553242f4/users/f1c7a90e90e5411f92eddd180ef9e27d/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:44:57.669631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3aae9-8545-4584-9e79-918486583edd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.670763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3aae9-8545-4584-9e79-918486583edd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.670763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3aae9-8545-4584-9e79-918486583edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.688995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-17f3aae9-8545-4584-9e79-918486583edd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:44:57.690198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-17f3aae9-8545-4584-9e79-918486583edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:57.751239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1118/2220] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:44:57.761353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:44:57.765855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:44:57.789190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:57.824726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc476be-518c-4e40-9619-0d7d801c5f19 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:44:57.831713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078a028-e2a1-47f4-8dc6-957ea3e37825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:44:57.831713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a028-e2a1-47f4-8dc6-957ea3e37825 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:44:57.831713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a028-e2a1-47f4-8dc6-957ea3e37825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:44:57.831713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a028-e2a1-47f4-8dc6-957ea3e37825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:44:57.840664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078a028-e2a1-47f4-8dc6-957ea3e37825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:44:57.842161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078a028-e2a1-47f4-8dc6-957ea3e37825 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:44:57.851920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1103/2221] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:45:03.719076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3ad9-f113-44e4-aa61-2fdbcfc17387 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:03.719617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3ad9-f113-44e4-aa61-2fdbcfc17387 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:03.719617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3ad9-f113-44e4-aa61-2fdbcfc17387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:03.750175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-65dc3ad9-f113-44e4-aa61-2fdbcfc17387 None None] MFA Rules not processed for user `f1c7a90e90e5411f92eddd180ef9e27d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:03.751431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-65dc3ad9-f113-44e4-aa61-2fdbcfc17387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:03.780778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:03.835205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1119/2222] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:45:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:45:03.839695 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078a028-e2a1-47f4-8dc6-957ea3e37825 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:03.850827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078a028-e2a1-47f4-8dc6-957ea3e37825 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:03.857901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea071cf-162d-4ae9-a20c-71131cff4380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:03.858616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea071cf-162d-4ae9-a20c-71131cff4380 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:03.858894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea071cf-162d-4ae9-a20c-71131cff4380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:03.859165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea071cf-162d-4ae9-a20c-71131cff4380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:03.860099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea071cf-162d-4ae9-a20c-71131cff4380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:03.873909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea071cf-162d-4ae9-a20c-71131cff4380 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:03.980422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1104/2223] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:45:03 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:45:03.984793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3ad9-f113-44e4-aa61-2fdbcfc17387 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:03.996627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3ad9-f113-44e4-aa61-2fdbcfc17387 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:04.059068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0de80-89f1-4458-9924-fca421e6a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:04.059589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0de80-89f1-4458-9924-fca421e6a522 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:04.059864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0de80-89f1-4458-9924-fca421e6a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:04.060128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0de80-89f1-4458-9924-fca421e6a522 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:04.060758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0de80-89f1-4458-9924-fca421e6a522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:04.062688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0de80-89f1-4458-9924-fca421e6a522 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:04.170143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1120/2224] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:45:03 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:45:04.175086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea071cf-162d-4ae9-a20c-71131cff4380 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:04.182350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea071cf-162d-4ae9-a20c-71131cff4380 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:04.187256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1735a6c-f37f-4556-8146-eb83fb990593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:04.187803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1735a6c-f37f-4556-8146-eb83fb990593 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:04.188081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1735a6c-f37f-4556-8146-eb83fb990593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:04.188379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1735a6c-f37f-4556-8146-eb83fb990593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:04.189035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1735a6c-f37f-4556-8146-eb83fb990593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:04.190689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1735a6c-f37f-4556-8146-eb83fb990593 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:04.205107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1105/2225] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:45:04.206317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0de80-89f1-4458-9924-fca421e6a522 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:04.218987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0de80-89f1-4458-9924-fca421e6a522 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:04.224878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbc6f4-6fac-44f3-8357-5875fcfd1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:04.225537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbc6f4-6fac-44f3-8357-5875fcfd1273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:04.225811 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbc6f4-6fac-44f3-8357-5875fcfd1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:04.226079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbc6f4-6fac-44f3-8357-5875fcfd1273 admin admin] PATH_INFO: `/v3/projects/44202d5e67bb4ac091570ad8a92b56df/users/6281762ed6bb4a34911ec6fa22099239/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:04.242624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbc6f4-6fac-44f3-8357-5875fcfd1273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44202d5e67bb4ac091570ad8a92b56df, user_id=6281762ed6bb4a34911ec6fa22099239, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:04.245450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbc6f4-6fac-44f3-8357-5875fcfd1273 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:04.321773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1121/2226] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:45:04 2022] PUT /identity/v3/projects/44202d5e67bb4ac091570ad8a92b56df/users/6281762ed6bb4a34911ec6fa22099239/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:45:04.325574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1735a6c-f37f-4556-8146-eb83fb990593 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:04.336753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1735a6c-f37f-4556-8146-eb83fb990593 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:04.396873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef863d4-b218-473e-9d26-3d2977a2246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:04.397485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef863d4-b218-473e-9d26-3d2977a2246d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:04.397761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef863d4-b218-473e-9d26-3d2977a2246d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:04.398036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef863d4-b218-473e-9d26-3d2977a2246d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:04.398721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef863d4-b218-473e-9d26-3d2977a2246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:04.400328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef863d4-b218-473e-9d26-3d2977a2246d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:04.410773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1106/2227] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:45:04.414774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbc6f4-6fac-44f3-8357-5875fcfd1273 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:04.425210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbc6f4-6fac-44f3-8357-5875fcfd1273 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:04.430225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:04.430919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:04.431194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:04.431460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] PATH_INFO: `/v3/projects/44202d5e67bb4ac091570ad8a92b56df/users/6281762ed6bb4a34911ec6fa22099239/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:04.433503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44202d5e67bb4ac091570ad8a92b56df, user_id=6281762ed6bb4a34911ec6fa22099239, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:04.436171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:04.447402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1122/2228] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:45:04 2022] PUT /identity/v3/projects/44202d5e67bb4ac091570ad8a92b56df/users/6281762ed6bb4a34911ec6fa22099239/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:45:08.439608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bcf6d-8f5e-4b86-afb8-0be8a7013c6f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:08.441294 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bcf6d-8f5e-4b86-afb8-0be8a7013c6f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:08.441751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bcf6d-8f5e-4b86-afb8-0be8a7013c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:08.472095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-313bcf6d-8f5e-4b86-afb8-0be8a7013c6f None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:08.474073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-313bcf6d-8f5e-4b86-afb8-0be8a7013c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:08.547429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1107/2229] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:45:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:45:08.577759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:08.577759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:08.668612 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb6cee-e1de-41f2-87db-5b2aee91b207 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:08.673882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:08.674519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:08.674807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:08.675079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:08.683554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:08.685139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:08.690115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:08.694238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1123/2230] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:45:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:45:11.496018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ed84-51c8-4f56-bcc4-b8bea82c04c3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:11.496593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ed84-51c8-4f56-bcc4-b8bea82c04c3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:11.496691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ed84-51c8-4f56-bcc4-b8bea82c04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:11.540639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3b43ed84-51c8-4f56-bcc4-b8bea82c04c3 None None] MFA Rules not processed for user `6281762ed6bb4a34911ec6fa22099239`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:11.542209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3b43ed84-51c8-4f56-bcc4-b8bea82c04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:11.568285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:11.672655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1108/2231] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:45:11.687713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:11.689833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:11.804955 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51f52-f244-414c-81a3-6d8a24e0ad11 service swift] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:11.810877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:11.811707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:11.813500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:11.813500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:11.919181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:11.921899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:11.943807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1124/2232] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:45:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:45:12.204054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ed84-51c8-4f56-bcc4-b8bea82c04c3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:12.329981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ed84-51c8-4f56-bcc4-b8bea82c04c3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:12.334641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a2983-e85d-48aa-af52-0be3d3dec923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:12.335894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2983-e85d-48aa-af52-0be3d3dec923 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:12.336257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2983-e85d-48aa-af52-0be3d3dec923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:12.336602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a2983-e85d-48aa-af52-0be3d3dec923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:12.338622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-761a2983-e85d-48aa-af52-0be3d3dec923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:12.477850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a2983-e85d-48aa-af52-0be3d3dec923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:12.478900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a2983-e85d-48aa-af52-0be3d3dec923 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:12.538275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1109/2233] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:45:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:45:21.934269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=56 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:22.522985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=70 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:26.920467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:26.921908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:27.000950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a30e82-ca78-4693-936d-4e974ef9b194 service nova] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:27.006384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ba647-d209-476c-b1ad-a9223c3ecfb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:27.007019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ba647-d209-476c-b1ad-a9223c3ecfb8 service placement] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:27.007295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ba647-d209-476c-b1ad-a9223c3ecfb8 service placement] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:27.007568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ba647-d209-476c-b1ad-a9223c3ecfb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:27.009289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-785ba647-d209-476c-b1ad-a9223c3ecfb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:27.021003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ba647-d209-476c-b1ad-a9223c3ecfb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:27.022629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ba647-d209-476c-b1ad-a9223c3ecfb8 service placement] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:27.034096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1125/2234] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:45:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:45:29.553850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c27b-01c0-48c3-990e-5c9371c6953b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:29.554398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c27b-01c0-48c3-990e-5c9371c6953b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:29.554398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7c27b-01c0-48c3-990e-5c9371c6953b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:29.555990 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1110/2235] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:45:29.562098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cce23-6ab2-44e7-9075-78f2f95f6010 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:29.562639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cce23-6ab2-44e7-9075-78f2f95f6010 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:29.562733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cce23-6ab2-44e7-9075-78f2f95f6010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:29.584349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-cf1cce23-6ab2-44e7-9075-78f2f95f6010 None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:29.585711 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cf1cce23-6ab2-44e7-9075-78f2f95f6010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:29.595724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1126/2236] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:45:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:45:29.613492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c27b-01c0-48c3-990e-5c9371c6953b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:29.615804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-26f7c27b-01c0-48c3-990e-5c9371c6953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:29.672865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7c27b-01c0-48c3-990e-5c9371c6953b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:29.677012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb52e79-6c1c-4b0d-83c3-3be07f985a9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb458a6186814aadb4ef178ff199582c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:29.681097 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb52e79-6c1c-4b0d-83c3-3be07f985a9a service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:29.681097 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb52e79-6c1c-4b0d-83c3-3be07f985a9a service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:29.681097 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb52e79-6c1c-4b0d-83c3-3be07f985a9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:29.688594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb52e79-6c1c-4b0d-83c3-3be07f985a9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:29.690056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb52e79-6c1c-4b0d-83c3-3be07f985a9a service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:29.709559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1111/2237] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:45:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:45:29.888713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41f0d-3535-4ec1-a314-725d84e25cc1 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:29.888989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41f0d-3535-4ec1-a314-725d84e25cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:29.889260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f41f0d-3535-4ec1-a314-725d84e25cc1 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:29.890624 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1127/2238] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:45:29.895360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b083-c44b-424c-83e1-b8b40ea3a966 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:29.895680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b083-c44b-424c-83e1-b8b40ea3a966 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:29.900118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b083-c44b-424c-83e1-b8b40ea3a966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:29.915718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a659b083-c44b-424c-83e1-b8b40ea3a966 None None] MFA Rules not processed for user `80c8c0985f6847368c4f7263b2bf8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:29.916899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a659b083-c44b-424c-83e1-b8b40ea3a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:29.923434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1112/2239] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:45:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:45:29.935984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f41f0d-3535-4ec1-a314-725d84e25cc1 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:29.937675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-16f41f0d-3535-4ec1-a314-725d84e25cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:29.951045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f41f0d-3535-4ec1-a314-725d84e25cc1 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:29.954693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de27065-a1eb-41c6-91a4-8991de23e1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:29.955310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de27065-a1eb-41c6-91a4-8991de23e1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:29.955603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de27065-a1eb-41c6-91a4-8991de23e1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:29.955874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de27065-a1eb-41c6-91a4-8991de23e1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:29.963060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de27065-a1eb-41c6-91a4-8991de23e1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:29.964476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de27065-a1eb-41c6-91a4-8991de23e1c2 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:29.972441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1128/2240] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:45:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:45:30.057458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295e37-ade0-417d-9d63-2f447116d300 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:30.057745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295e37-ade0-417d-9d63-2f447116d300 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:30.058019 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9295e37-ade0-417d-9d63-2f447116d300 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:30.059425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1113/2241] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:45:30.064294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159a52-8247-4250-bd5a-c82c31c0e4fd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:30.064577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159a52-8247-4250-bd5a-c82c31c0e4fd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:30.064847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159a52-8247-4250-bd5a-c82c31c0e4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:30.084375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-e6159a52-8247-4250-bd5a-c82c31c0e4fd None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:30.085635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e6159a52-8247-4250-bd5a-c82c31c0e4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:30.095008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1129/2242] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:45:30.105843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295e37-ade0-417d-9d63-2f447116d300 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:30.117177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9295e37-ade0-417d-9d63-2f447116d300 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:30.120810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed3559-0fea-4d75-8389-07135796f773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:30.121385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3559-0fea-4d75-8389-07135796f773 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:30.121659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3559-0fea-4d75-8389-07135796f773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:30.121921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3559-0fea-4d75-8389-07135796f773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:30.131878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed3559-0fea-4d75-8389-07135796f773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:30.133283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed3559-0fea-4d75-8389-07135796f773 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:30.143761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1114/2243] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:45:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:45:37.586842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077a808-2786-44d0-96e0-60c934703bd6 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:37.589194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077a808-2786-44d0-96e0-60c934703bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:37.589302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d0d1-c446-4552-827e-f242f945f81d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:37.589692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077a808-2786-44d0-96e0-60c934703bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:37.589788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d0d1-c446-4552-827e-f242f945f81d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:37.589788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7d0d1-c446-4552-827e-f242f945f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:37.606360 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a077a808-2786-44d0-96e0-60c934703bd6 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:37.607519 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a077a808-2786-44d0-96e0-60c934703bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:37.607904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-53e7d0d1-c446-4552-827e-f242f945f81d None None] MFA Rules not processed for user `4542138b7aa5446b8544dc766cbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:37.609172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-53e7d0d1-c446-4552-827e-f242f945f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:37.616984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1130/2244] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:45:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:45:37.629655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077a808-2786-44d0-96e0-60c934703bd6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:45:37.642719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077a808-2786-44d0-96e0-60c934703bd6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:45:37.647704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5b659-3791-4bef-b2b9-70a8893cb045 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:45:37.648301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b659-3791-4bef-b2b9-70a8893cb045 service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:37.648575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b659-3791-4bef-b2b9-70a8893cb045 service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:37.648839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b659-3791-4bef-b2b9-70a8893cb045 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:37.657399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5b659-3791-4bef-b2b9-70a8893cb045 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:45:37.659086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5b659-3791-4bef-b2b9-70a8893cb045 service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:45:37.667418 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1131/2245] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:45:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 08:45:37.686897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1115/2246] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:45:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:45:44.034973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf400f-6637-4944-be70-9cc486769083 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:45:44.035899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf400f-6637-4944-be70-9cc486769083 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:45:44.036335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf400f-6637-4944-be70-9cc486769083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:45:44.056469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8ecf400f-6637-4944-be70-9cc486769083 None None] MFA Rules not processed for user `f1c7a90e90e5411f92eddd180ef9e27d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:45:44.057682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8ecf400f-6637-4944-be70-9cc486769083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:45:44.068917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1132/2247] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:45:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:45:47.669821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=60 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:54.050964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=56 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:07.841484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6104-dd4a-44fc-99e8-42b450617da1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:46:07.854879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6104-dd4a-44fc-99e8-42b450617da1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:46:07.854879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6104-dd4a-44fc-99e8-42b450617da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:46:07.860957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-318b6104-dd4a-44fc-99e8-42b450617da1 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:46:07.862187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-318b6104-dd4a-44fc-99e8-42b450617da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:46:07.869882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1116/2248] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 10 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:46:07.889597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf400f-6637-4944-be70-9cc486769083 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:46:07.894445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf400f-6637-4944-be70-9cc486769083 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:46:07.899609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7a98-61d8-4d50-abe7-ed172839d532 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:46:07.900201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7a98-61d8-4d50-abe7-ed172839d532 service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:46:07.900479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7a98-61d8-4d50-abe7-ed172839d532 service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:46:07.900744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7a98-61d8-4d50-abe7-ed172839d532 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:46:07.909400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7a98-61d8-4d50-abe7-ed172839d532 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:46:07.911004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7a98-61d8-4d50-abe7-ed172839d532 service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:46:07.919148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1133/2249] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:46:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:46:17.856257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:17.915722 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=6 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:20.561055 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b6104-dd4a-44fc-99e8-42b450617da1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:46:20.570308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b6104-dd4a-44fc-99e8-42b450617da1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:46:20.573918 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7da66-b185-4fea-8a00-1bf76e916cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:46:20.574539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7da66-b185-4fea-8a00-1bf76e916cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:46:20.574822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7da66-b185-4fea-8a00-1bf76e916cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:46:20.575092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7da66-b185-4fea-8a00-1bf76e916cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:46:20.583891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7da66-b185-4fea-8a00-1bf76e916cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:46:20.585805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7da66-b185-4fea-8a00-1bf76e916cc2 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:46:20.595125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1117/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:46:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:46:29.634296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7a98-61d8-4d50-abe7-ed172839d532 service swift] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:46:29.643641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7a98-61d8-4d50-abe7-ed172839d532 service swift] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:46:29.647358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ed4fc-e68a-4711-95c5-88734a18b69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:46:29.647981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ed4fc-e68a-4711-95c5-88734a18b69a service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:46:29.648259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ed4fc-e68a-4711-95c5-88734a18b69a service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:46:29.648531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ed4fc-e68a-4711-95c5-88734a18b69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:46:29.650276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1f9ed4fc-e68a-4711-95c5-88734a18b69a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:46:29.664337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ed4fc-e68a-4711-95c5-88734a18b69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:46:29.665748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ed4fc-e68a-4711-95c5-88734a18b69a service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:46:29.676608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1134/2251] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:46:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:46:30.590889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:31.870077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7da66-b185-4fea-8a00-1bf76e916cc2 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:46:31.879386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7da66-b185-4fea-8a00-1bf76e916cc2 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:46:31.883586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:46:31.884168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:46:31.884443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:46:31.884705 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:46:31.886411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:46:31.899802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:46:31.901234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:46:31.912614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1118/2252] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:46:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:46:37.058938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a208-4883-4bb2-a91f-43679c4fdd02 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:46:37.059479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a208-4883-4bb2-a91f-43679c4fdd02 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:46:37.059479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a208-4883-4bb2-a91f-43679c4fdd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:46:37.077729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-d533a208-4883-4bb2-a91f-43679c4fdd02 None None] MFA Rules not processed for user `d28b7a7b2e0143cf9ee6e761eb7fb281`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:46:37.078949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d533a208-4883-4bb2-a91f-43679c4fdd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:46:37.132273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1135/2253] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:46:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:46:41.907653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:42.415763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:46:42.427097 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cb3bc-3672-4103-b99b-dcfcb583dcf0 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:46:42.433189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:46:42.433784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:46:42.434056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:46:42.434321 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:46:42.436063 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:46:42.497984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:46:42.499706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:46:42.509327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1119/2254] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:46:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:46:47.125751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=31 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:52.504617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=28 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:53.827092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533a208-4883-4bb2-a91f-43679c4fdd02 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:46:53.837929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533a208-4883-4bb2-a91f-43679c4fdd02 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:46:53.841937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:46:53.842683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:46:53.843061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:46:53.843429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:46:53.845777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:46:53.855868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:46:53.859005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:46:53.865571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1136/2255] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:46:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:47:03.862038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=6 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:26.819238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:47:26.820620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:26.835335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee14d51-7ae3-43a4-baad-211deb0e33d8 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:47:26.841313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6aee4-d92a-41f7-83c0-371887798787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:47:26.841904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6aee4-d92a-41f7-83c0-371887798787 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:47:26.842174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6aee4-d92a-41f7-83c0-371887798787 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:47:26.842436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6aee4-d92a-41f7-83c0-371887798787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:47:26.844173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-93b6aee4-d92a-41f7-83c0-371887798787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:26.899806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6aee4-d92a-41f7-83c0-371887798787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:47:26.901373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6aee4-d92a-41f7-83c0-371887798787 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:47:26.911145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1120/2256] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:47:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:47:32.963920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:47:32.978238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e80cc-2369-4926-99c8-5df3b102ca0f service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:47:32.984199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:47:32.984884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:47:32.985366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:47:32.985684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:47:32.987565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:33.000620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:47:33.002389 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:47:33.013691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1137/2257] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:47:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:47:36.907012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=28 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:37.829486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c08a-2c17-43c9-9ca4-208a13a10104 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:47:37.829766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c08a-2c17-43c9-9ca4-208a13a10104 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:47:37.830039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c08a-2c17-43c9-9ca4-208a13a10104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:47:37.848707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b876c08a-2c17-43c9-9ca4-208a13a10104 None None] MFA Rules not processed for user `0c316e7b121b4d859d9677edcb49be45`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:47:37.849889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b876c08a-2c17-43c9-9ca4-208a13a10104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:37.856685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1121/2258] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:47:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:47:38.159877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:47:38.169013 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1cd3f-377a-4a0c-bdfb-b14b26824cb5 service nova] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:47:38.173206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:47:38.173782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:47:38.174054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:47:38.174319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:47:38.176016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:38.185098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:47:38.186516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:47:38.194234 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1138/2259] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:47:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:47:38.619065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876c08a-2c17-43c9-9ca4-208a13a10104 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:47:38.631218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876c08a-2c17-43c9-9ca4-208a13a10104 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:47:38.636379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:47:38.636985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:47:38.637260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:47:38.637530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:47:38.639970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:38.652257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:47:38.653830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:47:38.664549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1122/2260] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:47:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:47:48.190751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=12 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:48.660251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=9 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:49.739767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:47:49.741394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:49.796420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ccd87-d404-4225-812b-64dbc7722904 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:47:49.800637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:47:49.801229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:47:49.801510 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:47:49.801783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:47:49.803576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:49.814884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:47:49.816309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:47:49.825160 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1139/2261] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:47:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:47:52.974606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:47:52.988063 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f804e79-4300-454a-947a-fddda625f4e7 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:47:52.993930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:47:52.997138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:47:52.997418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:47:52.997690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:47:52.999443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:47:53.012784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:47:53.014567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:47:53.025162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1123/2262] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:47:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:47:59.820984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=26 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:03.020829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:04.678243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:04.694919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d9e15-7c22-42e1-8706-3e9ab4d251f6 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:04.701859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafe283-5438-46b0-b114-1836c95bfbc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:04.702669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe283-5438-46b0-b114-1836c95bfbc9 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:04.703051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe283-5438-46b0-b114-1836c95bfbc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:04.703430 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe283-5438-46b0-b114-1836c95bfbc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:04.705996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3cafe283-5438-46b0-b114-1836c95bfbc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:04.720974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafe283-5438-46b0-b114-1836c95bfbc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:04.722768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafe283-5438-46b0-b114-1836c95bfbc9 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:04.733289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1140/2263] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:06.253498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:06.279701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0e6ed-a9ef-4bf5-8e6f-eeb8489970d4 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:06.298403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47206fef-4ce0-4211-aa02-95ecdf79dbb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:06.299051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206fef-4ce0-4211-aa02-95ecdf79dbb2 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:06.299323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206fef-4ce0-4211-aa02-95ecdf79dbb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:06.299664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47206fef-4ce0-4211-aa02-95ecdf79dbb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:06.307919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-47206fef-4ce0-4211-aa02-95ecdf79dbb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:06.336289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47206fef-4ce0-4211-aa02-95ecdf79dbb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:06.340325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47206fef-4ce0-4211-aa02-95ecdf79dbb2 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:06.368595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1124/2264] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:09.122129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d997784-5a1d-47c4-9c46-62b1b6b3a1d8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:09.123032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d997784-5a1d-47c4-9c46-62b1b6b3a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:09.123314 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d997784-5a1d-47c4-9c46-62b1b6b3a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:09.167354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1d997784-5a1d-47c4-9c46-62b1b6b3a1d8 None None] MFA Rules not processed for user `4542138b7aa5446b8544dc766cbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:09.168631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1d997784-5a1d-47c4-9c46-62b1b6b3a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:09.185999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1141/2265] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:11.086906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e7b4-df01-4797-9932-4e93b40d2a1f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:11.087395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e7b4-df01-4797-9932-4e93b40d2a1f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:11.087491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e7b4-df01-4797-9932-4e93b40d2a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:11.107532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-58c6e7b4-df01-4797-9932-4e93b40d2a1f None None] MFA Rules not processed for user `661a67fbdd6941889c706d2560c920a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:11.108751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-58c6e7b4-df01-4797-9932-4e93b40d2a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:11.115793 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1125/2266] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:11.421948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d997784-5a1d-47c4-9c46-62b1b6b3a1d8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:11.432075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d997784-5a1d-47c4-9c46-62b1b6b3a1d8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:11.435603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:11.436189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:11.436464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:11.436732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:11.439098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:11.448442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:11.449872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:11.458116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1142/2267] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:18.446092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175caaa-8488-4582-8c45-834f6ca30a0d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:18.446498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175caaa-8488-4582-8c45-834f6ca30a0d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:18.446732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175caaa-8488-4582-8c45-834f6ca30a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:18.477929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4175caaa-8488-4582-8c45-834f6ca30a0d None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:18.481141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4175caaa-8488-4582-8c45-834f6ca30a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:18.488134 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1126/2268] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 10 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:18.637099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:18.658126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebc06a-12f6-4df3-a7d4-e99571757a49 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:18.664238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:18.666062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:18.666416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:18.666786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:18.678364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:18.680129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:18.690410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1143/2269] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:48:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:48:19.103534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175caaa-8488-4582-8c45-834f6ca30a0d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:19.112976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175caaa-8488-4582-8c45-834f6ca30a0d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:19.116643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:19.117240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:19.117513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:19.117778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:19.119505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:19.182447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:19.183887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:19.193279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1127/2270] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:24.870430 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:24.871956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:24.894627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1f194-e266-44a6-957a-020f68a3b1db service swift] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:24.903644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:24.904598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:24.905454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:24.905585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:24.909410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:24.925292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:24.927340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:24.950346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1144/2271] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:25.097428 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:25.098961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:25.112416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c66c09-b17f-4c87-93a6-c0f6b093ec8f service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:25.118065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:25.118872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:25.119219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:25.119499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] PATH_INFO: `/v3/users/d28b7a7b2e0143cf9ee6e761eb7fb281` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:25.120740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28b7a7b2e0143cf9ee6e761eb7fb281)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:25.123076 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:25.337016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28b7a7b2e0143cf9ee6e761eb7fb281'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:25.436094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28b7a7b2e0143cf9ee6e761eb7fb281'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:25.452349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28b7a7b2e0143cf9ee6e761eb7fb281'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:25.475617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28b7a7b2e0143cf9ee6e761eb7fb281'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:25.481074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bae7d2aa-c012-4c0e-ab5d-f79775ca0d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28b7a7b2e0143cf9ee6e761eb7fb281'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:25.487642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1128/2272] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:25 2022] DELETE /identity/v3/users/d28b7a7b2e0143cf9ee6e761eb7fb281 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:26.073022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:26.084581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ee08a-d3e6-4067-9267-be1198186bd0 service placement] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:26.175980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:26.177031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:26.177320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:26.177593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] PATH_INFO: `/v3/projects/5c6694dd460a467a986bcaa0e5e000a9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:26.178963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6694dd460a467a986bcaa0e5e000a9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:26.181945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:26.335457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6694dd460a467a986bcaa0e5e000a9', 'request_id': 'req-5134296b-a02b-4f6c-8512-5f969dfdc58e'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:26.341367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6694dd460a467a986bcaa0e5e000a9', 'request_id': 'req-5134296b-a02b-4f6c-8512-5f969dfdc58e'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:26.348784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6694dd460a467a986bcaa0e5e000a9', 'request_id': 'req-5134296b-a02b-4f6c-8512-5f969dfdc58e'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:26.448927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] The token cache is being invalidate because project 5c6694dd460a467a986bcaa0e5e000a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:26.449126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:26.449821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5134296b-a02b-4f6c-8512-5f969dfdc58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:26.451409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1145/2273] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:26 2022] DELETE /identity/v3/projects/5c6694dd460a467a986bcaa0e5e000a9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:26.457024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556e77-08e9-4ac1-9052-5d8355d2f0d8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:26.457504 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556e77-08e9-4ac1-9052-5d8355d2f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:26.457601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556e77-08e9-4ac1-9052-5d8355d2f0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:26.477552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-eb556e77-08e9-4ac1-9052-5d8355d2f0d8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:26.478788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb556e77-08e9-4ac1-9052-5d8355d2f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:26.512170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:26.545603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1129/2274] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:26.547447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cfbe0-0d24-4bc5-ad1c-46dcc73359e7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:26.548012 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cfbe0-0d24-4bc5-ad1c-46dcc73359e7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:26.548440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cfbe0-0d24-4bc5-ad1c-46dcc73359e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:26.571578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-007cfbe0-0d24-4bc5-ad1c-46dcc73359e7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:26.572859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-007cfbe0-0d24-4bc5-ad1c-46dcc73359e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:26.581853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1146/2275] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:48:26.586448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556e77-08e9-4ac1-9052-5d8355d2f0d8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:26.596569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556e77-08e9-4ac1-9052-5d8355d2f0d8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:26.601320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:26.601919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:26.602193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:26.602460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:26.603139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:48:26.603439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:26.605025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:26.617183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1130/2276] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:48:26.621674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cfbe0-0d24-4bc5-ad1c-46dcc73359e7 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:26.631710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cfbe0-0d24-4bc5-ad1c-46dcc73359e7 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:26.636441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75410321-5016-4c1a-8d13-1355ea061333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:26.637019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75410321-5016-4c1a-8d13-1355ea061333 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:26.637289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75410321-5016-4c1a-8d13-1355ea061333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:26.637553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75410321-5016-4c1a-8d13-1355ea061333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:26.638162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75410321-5016-4c1a-8d13-1355ea061333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:26.640237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75410321-5016-4c1a-8d13-1355ea061333 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:26.769564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1147/2277] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:48:26 2022] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:26.773746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:26.786152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c5e92-c65f-4be4-ac8a-cd8ee46a0e6f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:26.850537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544abfe-0687-4a40-978d-14dba1b69eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:26.851168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544abfe-0687-4a40-978d-14dba1b69eea admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:26.851443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544abfe-0687-4a40-978d-14dba1b69eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:26.851715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544abfe-0687-4a40-978d-14dba1b69eea admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:26.852358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544abfe-0687-4a40-978d-14dba1b69eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:26.854301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544abfe-0687-4a40-978d-14dba1b69eea admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:26.918774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1131/2278] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:48:26 2022] POST /identity/v3/users => generated 302 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:48:26.927879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75410321-5016-4c1a-8d13-1355ea061333 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:26.935757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:26.942015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75410321-5016-4c1a-8d13-1355ea061333 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:26.947382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79db6-34c5-4b97-89c1-f8f6acc43e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:26.951217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79db6-34c5-4b97-89c1-f8f6acc43e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:26.951217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79db6-34c5-4b97-89c1-f8f6acc43e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:26.951217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79db6-34c5-4b97-89c1-f8f6acc43e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:26.951217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd79db6-34c5-4b97-89c1-f8f6acc43e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:26.951217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd79db6-34c5-4b97-89c1-f8f6acc43e0f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:26.962812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1148/2279] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:26.966443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544abfe-0687-4a40-978d-14dba1b69eea admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:26.976611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544abfe-0687-4a40-978d-14dba1b69eea admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:26.981547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864a6b-11d3-45a9-a6a3-9288e500c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:26.982136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864a6b-11d3-45a9-a6a3-9288e500c3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:26.982411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864a6b-11d3-45a9-a6a3-9288e500c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:26.982704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864a6b-11d3-45a9-a6a3-9288e500c3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:26.983338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba864a6b-11d3-45a9-a6a3-9288e500c3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:26.985062 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba864a6b-11d3-45a9-a6a3-9288e500c3e4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:26.995762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1132/2280] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:48:26.999912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79db6-34c5-4b97-89c1-f8f6acc43e0f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:27.012036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79db6-34c5-4b97-89c1-f8f6acc43e0f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:27.018201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:27.018627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:27.018925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:27.021284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] PATH_INFO: `/v3/projects/83ca9d784c9141a594694aa7a8751085/users/d501d4247e644aac917799292a43a02f/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:27.035810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ca9d784c9141a594694aa7a8751085, user_id=d501d4247e644aac917799292a43a02f, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:27.038849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:27.106946 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1149/2281] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:26 2022] PUT /identity/v3/projects/83ca9d784c9141a594694aa7a8751085/users/d501d4247e644aac917799292a43a02f/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:27.111844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d0ea-a69a-4f27-9b8f-c174527d0df7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:27.112299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d0ea-a69a-4f27-9b8f-c174527d0df7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:27.112678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d0ea-a69a-4f27-9b8f-c174527d0df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:27.133345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5425d0ea-a69a-4f27-9b8f-c174527d0df7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:27.134573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5425d0ea-a69a-4f27-9b8f-c174527d0df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:27.199246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1133/2282] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:27.208415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:27.210151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:27.289290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bdcdd-d72c-4910-9305-cfea5c5373a7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:27.293191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a82d1-9e63-4c0d-828b-cca6a15a7365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:27.295576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a82d1-9e63-4c0d-828b-cca6a15a7365 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:27.295576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a82d1-9e63-4c0d-828b-cca6a15a7365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:27.295576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a82d1-9e63-4c0d-828b-cca6a15a7365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:27.304705 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a82d1-9e63-4c0d-828b-cca6a15a7365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:27.306140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a82d1-9e63-4c0d-828b-cca6a15a7365 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:27.340143 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1150/2283] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:29.045725 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c9ce-e4d6-43e1-801a-c16cd5c9a0f1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:29.048072 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c9ce-e4d6-43e1-801a-c16cd5c9a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:29.048663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c9ce-e4d6-43e1-801a-c16cd5c9a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:29.081910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f607c9ce-e4d6-43e1-801a-c16cd5c9a0f1 None None] MFA Rules not processed for user `d501d4247e644aac917799292a43a02f`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:29.083591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f607c9ce-e4d6-43e1-801a-c16cd5c9a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:29.132686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:29.167056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1134/2284] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:29.168528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a82d1-9e63-4c0d-828b-cca6a15a7365 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:29.180672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a82d1-9e63-4c0d-828b-cca6a15a7365 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:29.186304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43300b-66b8-4079-8a01-1ac2c67f679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:29.186957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43300b-66b8-4079-8a01-1ac2c67f679c admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:29.187481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43300b-66b8-4079-8a01-1ac2c67f679c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:29.187784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43300b-66b8-4079-8a01-1ac2c67f679c admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:29.188402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43300b-66b8-4079-8a01-1ac2c67f679c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:29.191096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43300b-66b8-4079-8a01-1ac2c67f679c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:29.281814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1151/2285] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:48:29 2022] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:48:29.287945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c9ce-e4d6-43e1-801a-c16cd5c9a0f1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:29.302863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c9ce-e4d6-43e1-801a-c16cd5c9a0f1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:29.368876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2705b7-e752-4251-ac18-97b042ae6744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:29.369560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2705b7-e752-4251-ac18-97b042ae6744 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:29.369843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2705b7-e752-4251-ac18-97b042ae6744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:29.370117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2705b7-e752-4251-ac18-97b042ae6744 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:29.370781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2705b7-e752-4251-ac18-97b042ae6744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:29.372752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2705b7-e752-4251-ac18-97b042ae6744 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:29.485182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1135/2286] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:48:29 2022] POST /identity/v3/users => generated 308 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:29.490966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43300b-66b8-4079-8a01-1ac2c67f679c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:29.508542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43300b-66b8-4079-8a01-1ac2c67f679c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:29.515847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf09a1-daf0-45f9-bd22-296517fc1257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:29.516856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf09a1-daf0-45f9-bd22-296517fc1257 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:29.516856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf09a1-daf0-45f9-bd22-296517fc1257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:29.517126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf09a1-daf0-45f9-bd22-296517fc1257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:29.518040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf09a1-daf0-45f9-bd22-296517fc1257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:29.519997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf09a1-daf0-45f9-bd22-296517fc1257 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:29.534893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1152/2287] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:29.536674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2705b7-e752-4251-ac18-97b042ae6744 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:29.549561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2705b7-e752-4251-ac18-97b042ae6744 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:29.555100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b26f-0d2a-4a1c-9586-b190a02f1470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:29.555937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b26f-0d2a-4a1c-9586-b190a02f1470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:29.556219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b26f-0d2a-4a1c-9586-b190a02f1470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:29.556500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5b26f-0d2a-4a1c-9586-b190a02f1470 admin admin] PATH_INFO: `/v3/projects/86b4153f52674062a4c21454b39406c3/users/ddd73d3a4fc24a01aa85c446e97cc51c/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:29.583778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5b26f-0d2a-4a1c-9586-b190a02f1470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b4153f52674062a4c21454b39406c3, user_id=ddd73d3a4fc24a01aa85c446e97cc51c, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:29.587284 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5b26f-0d2a-4a1c-9586-b190a02f1470 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:29.691738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1136/2288] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:29 2022] PUT /identity/v3/projects/86b4153f52674062a4c21454b39406c3/users/ddd73d3a4fc24a01aa85c446e97cc51c/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:29.696131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf09a1-daf0-45f9-bd22-296517fc1257 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:29.707718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf09a1-daf0-45f9-bd22-296517fc1257 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:29.776377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:29.783080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:29.783080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:29.783080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:29.783080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:29.783080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:29.794164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1153/2289] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:48:29.799149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b26f-0d2a-4a1c-9586-b190a02f1470 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:29.811275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5b26f-0d2a-4a1c-9586-b190a02f1470 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:29.816253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:29.816914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:29.817189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:29.817472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] PATH_INFO: `/v3/projects/86b4153f52674062a4c21454b39406c3/users/ddd73d3a4fc24a01aa85c446e97cc51c/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:29.819939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b4153f52674062a4c21454b39406c3, user_id=ddd73d3a4fc24a01aa85c446e97cc51c, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:29.823547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:29.833934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1137/2290] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:29 2022] PUT /identity/v3/projects/86b4153f52674062a4c21454b39406c3/users/ddd73d3a4fc24a01aa85c446e97cc51c/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:48:30.272431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:30.278588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:30.292274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38959803-793b-4706-8e2a-c4ca8883c578 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:30.339918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:30.371730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:30.372380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:30.372809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:30.373083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] PATH_INFO: `/v3/users/12404366fbba4d1dbb554dcfe65c34d9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:30.374405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12404366fbba4d1dbb554dcfe65c34d9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:30.376644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:30.632021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12404366fbba4d1dbb554dcfe65c34d9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:30.644219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12404366fbba4d1dbb554dcfe65c34d9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:30.735364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12404366fbba4d1dbb554dcfe65c34d9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:30.736044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12404366fbba4d1dbb554dcfe65c34d9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:30.749978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12404366fbba4d1dbb554dcfe65c34d9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:30.758287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1154/2291] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:30 2022] DELETE /identity/v3/users/12404366fbba4d1dbb554dcfe65c34d9 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:31.181486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:31.186112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:31.209930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b0e54-938a-44f5-9b2c-cd48f5f0d708 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:31.289347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:31.290896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:31.290896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:31.290896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] PATH_INFO: `/v3/projects/970da6acbc464dee8191789eec7ba844` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:31.291958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970da6acbc464dee8191789eec7ba844)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:31.293903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:31.380156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:31.393439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970da6acbc464dee8191789eec7ba844', 'request_id': 'req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.476536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970da6acbc464dee8191789eec7ba844', 'request_id': 'req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.488872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970da6acbc464dee8191789eec7ba844', 'request_id': 'req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.502372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] The token cache is being invalidate because project 970da6acbc464dee8191789eec7ba844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:31.502696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.504020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6fa00136-9bf0-47b2-a5de-fb67a3b8f4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.509662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:31.511204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1138/2292] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:31 2022] DELETE /identity/v3/projects/970da6acbc464dee8191789eec7ba844 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:31.521154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c7130-b4da-4df6-8032-52bdb691f43e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:31.569899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f648-776f-4930-9d34-ef24e9cdd3dd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:31.570212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f648-776f-4930-9d34-ef24e9cdd3dd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:31.571091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f648-776f-4930-9d34-ef24e9cdd3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:31.589745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:31.590384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:31.591020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:31.591020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] PATH_INFO: `/v3/users/c1a1dfb504da496db9691d11f8bbb4aa` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:31.592083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a1dfb504da496db9691d11f8bbb4aa)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:31.593998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:31.603247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d622f648-776f-4930-9d34-ef24e9cdd3dd None None] MFA Rules not processed for user `ddd73d3a4fc24a01aa85c446e97cc51c`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:31.604659 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d622f648-776f-4930-9d34-ef24e9cdd3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:31.682959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1139/2293] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:48:31.791554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a1dfb504da496db9691d11f8bbb4aa'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.805486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:31.807876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a1dfb504da496db9691d11f8bbb4aa'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.900976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a1dfb504da496db9691d11f8bbb4aa'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.901910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a1dfb504da496db9691d11f8bbb4aa'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.916714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a1dfb504da496db9691d11f8bbb4aa'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:31.926688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1155/2294] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:31 2022] DELETE /identity/v3/users/c1a1dfb504da496db9691d11f8bbb4aa => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:32.225472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f648-776f-4930-9d34-ef24e9cdd3dd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:32.227032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d622f648-776f-4930-9d34-ef24e9cdd3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:32.245586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f648-776f-4930-9d34-ef24e9cdd3dd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:32.302733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:32.303501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:32.303845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:32.304899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] PATH_INFO: `/v3/projects/b3929184dbc34d198e60fbcb19331ebb` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:32.305272 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3929184dbc34d198e60fbcb19331ebb)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:32.307229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:32.425370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:32.428126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3929184dbc34d198e60fbcb19331ebb', 'request_id': 'req-e0825504-2358-43a5-93f2-011e7a8075fc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:32.523715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3929184dbc34d198e60fbcb19331ebb', 'request_id': 'req-e0825504-2358-43a5-93f2-011e7a8075fc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:32.542909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3929184dbc34d198e60fbcb19331ebb', 'request_id': 'req-e0825504-2358-43a5-93f2-011e7a8075fc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:32.555723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] The token cache is being invalidate because project b3929184dbc34d198e60fbcb19331ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:32.556103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:32.556879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:32.558393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1140/2295] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:32 2022] DELETE /identity/v3/projects/b3929184dbc34d198e60fbcb19331ebb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:33.342792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:33.346896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:33.362600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691525-c63c-4062-ab7c-31c4c646db66 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:33.420256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:33.420894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:33.421176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:33.421444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] PATH_INFO: `/v3/users/d501d4247e644aac917799292a43a02f` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:33.423148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d501d4247e644aac917799292a43a02f)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:33.425117 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:33.647220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd501d4247e644aac917799292a43a02f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:33.657455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd501d4247e644aac917799292a43a02f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:33.768040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd501d4247e644aac917799292a43a02f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:33.768700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd501d4247e644aac917799292a43a02f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:33.783267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd501d4247e644aac917799292a43a02f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:33.791769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1156/2296] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:33 2022] DELETE /identity/v3/users/d501d4247e644aac917799292a43a02f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:34.033458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:34.034996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:34.049967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825504-2358-43a5-93f2-011e7a8075fc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:34.116045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:34.116745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:34.117022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:34.117301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] PATH_INFO: `/v3/projects/83ca9d784c9141a594694aa7a8751085` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:34.118444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ca9d784c9141a594694aa7a8751085)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:34.120425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:34.233762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ca9d784c9141a594694aa7a8751085', 'request_id': 'req-f493e0b5-ec0a-400c-834f-b09b1bb68659'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.311957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ca9d784c9141a594694aa7a8751085', 'request_id': 'req-f493e0b5-ec0a-400c-834f-b09b1bb68659'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.319475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ca9d784c9141a594694aa7a8751085', 'request_id': 'req-f493e0b5-ec0a-400c-834f-b09b1bb68659'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.331250 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] The token cache is being invalidate because project 83ca9d784c9141a594694aa7a8751085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:34.331533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.332574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.333782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1141/2297] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:34 2022] DELETE /identity/v3/projects/83ca9d784c9141a594694aa7a8751085 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:48:34.337844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:34.339323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:34.352039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a79b3c-9e16-43c2-a6f2-22f5c55a43c8 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:34.398947 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:34.408683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:34.409306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:34.409583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:34.409849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] PATH_INFO: `/v3/users/ddd73d3a4fc24a01aa85c446e97cc51c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:34.410981 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd73d3a4fc24a01aa85c446e97cc51c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:34.412881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:34.685917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd73d3a4fc24a01aa85c446e97cc51c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.693430 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd73d3a4fc24a01aa85c446e97cc51c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.769366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd73d3a4fc24a01aa85c446e97cc51c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.769971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd73d3a4fc24a01aa85c446e97cc51c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.783027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-19f22cf5-2c6c-4ccf-834e-9e17ce8c0644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd73d3a4fc24a01aa85c446e97cc51c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:34.788952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1157/2298] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:34 2022] DELETE /identity/v3/users/ddd73d3a4fc24a01aa85c446e97cc51c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:35.034215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:35.035702 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:35.051363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493e0b5-ec0a-400c-834f-b09b1bb68659 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:35.108480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:35.109116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.110040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.110315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] PATH_INFO: `/v3/projects/86b4153f52674062a4c21454b39406c3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.111482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b4153f52674062a4c21454b39406c3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:35.113384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:35.119429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:35.238554 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b4153f52674062a4c21454b39406c3', 'request_id': 'req-d629dc16-98b5-44ff-b4a1-3455070380d1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:35.306376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b4153f52674062a4c21454b39406c3', 'request_id': 'req-d629dc16-98b5-44ff-b4a1-3455070380d1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:35.313381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b4153f52674062a4c21454b39406c3', 'request_id': 'req-d629dc16-98b5-44ff-b4a1-3455070380d1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:35.323900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] The token cache is being invalidate because project 86b4153f52674062a4c21454b39406c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:35.324186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:35.324824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d629dc16-98b5-44ff-b4a1-3455070380d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:35.326301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1142/2299] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:35 2022] DELETE /identity/v3/projects/86b4153f52674062a4c21454b39406c3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:35.331131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bdb53-0240-4a6c-89ad-424a0ce99ca7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.331411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bdb53-0240-4a6c-89ad-424a0ce99ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.331679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bdb53-0240-4a6c-89ad-424a0ce99ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.351187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-519bdb53-0240-4a6c-89ad-424a0ce99ca7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:35.352384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-519bdb53-0240-4a6c-89ad-424a0ce99ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:35.411233 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1158/2300] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:35.418947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fc3bf-27bd-4802-9843-d1e0505df25b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.419236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fc3bf-27bd-4802-9843-d1e0505df25b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.419517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fc3bf-27bd-4802-9843-d1e0505df25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.438895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-504fc3bf-27bd-4802-9843-d1e0505df25b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:35.440104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-504fc3bf-27bd-4802-9843-d1e0505df25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:35.447973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1143/2301] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:35.452133 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bdb53-0240-4a6c-89ad-424a0ce99ca7 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:35.462105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bdb53-0240-4a6c-89ad-424a0ce99ca7 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:35.466749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:35.467331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.467608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.467877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.468520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:48:35.469443 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:35.471052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:35.482330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1159/2302] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:48:35.486563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fc3bf-27bd-4802-9843-d1e0505df25b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:35.495795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fc3bf-27bd-4802-9843-d1e0505df25b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:35.500394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667602-2996-4cd6-9ded-ec63d6a58d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:35.501001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667602-2996-4cd6-9ded-ec63d6a58d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.501277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667602-2996-4cd6-9ded-ec63d6a58d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.501543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be667602-2996-4cd6-9ded-ec63d6a58d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.502201 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be667602-2996-4cd6-9ded-ec63d6a58d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:35.504377 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be667602-2996-4cd6-9ded-ec63d6a58d1e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:35.587212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1144/2303] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:48:35 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:35.591588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:35.602295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad390e-ba0f-42ca-a332-16cb4401b728 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:35.650723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:35.657045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2750525-6ecc-4d72-a499-03f89475e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:35.657634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750525-6ecc-4d72-a499-03f89475e4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.657908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750525-6ecc-4d72-a499-03f89475e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.658177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2750525-6ecc-4d72-a499-03f89475e4ed admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.658822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2750525-6ecc-4d72-a499-03f89475e4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:35.662915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2750525-6ecc-4d72-a499-03f89475e4ed admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:35.769507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1160/2304] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:48:35 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:48:35.773787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667602-2996-4cd6-9ded-ec63d6a58d1e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:35.784976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be667602-2996-4cd6-9ded-ec63d6a58d1e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:35.789649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca36f0-16fe-4bd2-9fe0-6fa234b57db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:35.790237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca36f0-16fe-4bd2-9fe0-6fa234b57db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.790638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca36f0-16fe-4bd2-9fe0-6fa234b57db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.790907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca36f0-16fe-4bd2-9fe0-6fa234b57db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.791546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca36f0-16fe-4bd2-9fe0-6fa234b57db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:35.793103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca36f0-16fe-4bd2-9fe0-6fa234b57db1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:35.802761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1145/2305] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:35.810212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2750525-6ecc-4d72-a499-03f89475e4ed admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:35.820552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2750525-6ecc-4d72-a499-03f89475e4ed admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:35.825174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb1852-f6fb-4472-85c5-46190601cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:35.825748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1852-f6fb-4472-85c5-46190601cc64 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.826024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1852-f6fb-4472-85c5-46190601cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.826286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1852-f6fb-4472-85c5-46190601cc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.826949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb1852-f6fb-4472-85c5-46190601cc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:35.829158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb1852-f6fb-4472-85c5-46190601cc64 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:35.839395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1161/2306] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:48:35.843481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca36f0-16fe-4bd2-9fe0-6fa234b57db1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:35.855113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca36f0-16fe-4bd2-9fe0-6fa234b57db1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:35.859723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d62f-50b1-47a1-8cef-b022331c1da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:35.860358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d62f-50b1-47a1-8cef-b022331c1da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.860629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d62f-50b1-47a1-8cef-b022331c1da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.860894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d62f-50b1-47a1-8cef-b022331c1da7 admin admin] PATH_INFO: `/v3/projects/9bb14cd6272b445c86a27e6eeb561cd4/users/403af7a2b6894bb5afba2b74b69c195d/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.875505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6d62f-50b1-47a1-8cef-b022331c1da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb14cd6272b445c86a27e6eeb561cd4, user_id=403af7a2b6894bb5afba2b74b69c195d, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:35.878128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6d62f-50b1-47a1-8cef-b022331c1da7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:35.941061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1146/2307] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:35 2022] PUT /identity/v3/projects/9bb14cd6272b445c86a27e6eeb561cd4/users/403af7a2b6894bb5afba2b74b69c195d/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:48:35.952166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c60a8-39aa-4c3a-8466-0038cdad7b7a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:35.952628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c60a8-39aa-4c3a-8466-0038cdad7b7a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:35.953017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c60a8-39aa-4c3a-8466-0038cdad7b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:35.980755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-c08c60a8-39aa-4c3a-8466-0038cdad7b7a None None] MFA Rules not processed for user `403af7a2b6894bb5afba2b74b69c195d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:35.981993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c08c60a8-39aa-4c3a-8466-0038cdad7b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:36.045601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1162/2308] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:48:36.050123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d62f-50b1-47a1-8cef-b022331c1da7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:36.114629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d62f-50b1-47a1-8cef-b022331c1da7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:36.119545 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49164838-bbbd-4206-b68d-e61cb0c3e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:36.120148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49164838-bbbd-4206-b68d-e61cb0c3e574 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:36.120427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49164838-bbbd-4206-b68d-e61cb0c3e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:36.120744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49164838-bbbd-4206-b68d-e61cb0c3e574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:36.121311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49164838-bbbd-4206-b68d-e61cb0c3e574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:36.123276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49164838-bbbd-4206-b68d-e61cb0c3e574 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:36.213599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1147/2309] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:48:36 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:36.217900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c60a8-39aa-4c3a-8466-0038cdad7b7a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:36.228897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c60a8-39aa-4c3a-8466-0038cdad7b7a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:36.289445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d27df-5127-46ac-9e7d-a7ba9834146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:36.290139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d27df-5127-46ac-9e7d-a7ba9834146c admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:36.290420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d27df-5127-46ac-9e7d-a7ba9834146c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:36.290723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d27df-5127-46ac-9e7d-a7ba9834146c admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:36.291349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d27df-5127-46ac-9e7d-a7ba9834146c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:36.293281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d27df-5127-46ac-9e7d-a7ba9834146c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:36.374382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1163/2310] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:48:36 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:48:36.379014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49164838-bbbd-4206-b68d-e61cb0c3e574 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:36.389422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49164838-bbbd-4206-b68d-e61cb0c3e574 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:36.393945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6668-20d6-4ded-acdb-ac62a4eddd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:36.394563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6668-20d6-4ded-acdb-ac62a4eddd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:36.400650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6668-20d6-4ded-acdb-ac62a4eddd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:36.400650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6668-20d6-4ded-acdb-ac62a4eddd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:36.400650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d6668-20d6-4ded-acdb-ac62a4eddd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:36.400650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d6668-20d6-4ded-acdb-ac62a4eddd5a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:36.410093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1148/2311] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:36.414678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d27df-5127-46ac-9e7d-a7ba9834146c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:36.425242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d27df-5127-46ac-9e7d-a7ba9834146c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:36.429859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce3858-f165-47be-b761-1b73423ef6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:36.430596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce3858-f165-47be-b761-1b73423ef6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:36.430880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce3858-f165-47be-b761-1b73423ef6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:36.431179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce3858-f165-47be-b761-1b73423ef6b4 admin admin] PATH_INFO: `/v3/projects/7379fdeb6c1142b59e315553a7267867/users/df9d8b87ffb6422ba0ffc715e3531e25/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:36.446101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce3858-f165-47be-b761-1b73423ef6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7379fdeb6c1142b59e315553a7267867, user_id=df9d8b87ffb6422ba0ffc715e3531e25, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:36.448813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce3858-f165-47be-b761-1b73423ef6b4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:36.540448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1164/2312] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:36 2022] PUT /identity/v3/projects/7379fdeb6c1142b59e315553a7267867/users/df9d8b87ffb6422ba0ffc715e3531e25/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:36.544520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6668-20d6-4ded-acdb-ac62a4eddd5a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:36.551728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:36.555788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6668-20d6-4ded-acdb-ac62a4eddd5a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:36.608967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb4077-d278-4fc1-8cbe-1e8898635522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:36.610118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb4077-d278-4fc1-8cbe-1e8898635522 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:36.610392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb4077-d278-4fc1-8cbe-1e8898635522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:36.610693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb4077-d278-4fc1-8cbe-1e8898635522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:36.611325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb4077-d278-4fc1-8cbe-1e8898635522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:36.612970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb4077-d278-4fc1-8cbe-1e8898635522 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:36.622353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1149/2313] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:36.626687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce3858-f165-47be-b761-1b73423ef6b4 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:36.637230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce3858-f165-47be-b761-1b73423ef6b4 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:36.641963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:36.642636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:36.642915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:36.643184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] PATH_INFO: `/v3/projects/7379fdeb6c1142b59e315553a7267867/users/df9d8b87ffb6422ba0ffc715e3531e25/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:36.645112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7379fdeb6c1142b59e315553a7267867, user_id=df9d8b87ffb6422ba0ffc715e3531e25, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:36.647774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:36.658703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1165/2314] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:36 2022] PUT /identity/v3/projects/7379fdeb6c1142b59e315553a7267867/users/df9d8b87ffb6422ba0ffc715e3531e25/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:36.668941 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e946f-1957-4812-b418-728248bc5e3f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:36.669225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e946f-1957-4812-b418-728248bc5e3f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:36.669496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e946f-1957-4812-b418-728248bc5e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:36.696779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-106e946f-1957-4812-b418-728248bc5e3f None None] MFA Rules not processed for user `df9d8b87ffb6422ba0ffc715e3531e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:36.697986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-106e946f-1957-4812-b418-728248bc5e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:36.763679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1150/2315] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:36.775586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:36.777286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:36.799075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:36.834643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468b27-cf74-4e4a-9ac7-e0d248ccc178 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:36.838343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af4a96-af73-4a79-a6de-6ba9cb574f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:36.838963 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4a96-af73-4a79-a6de-6ba9cb574f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:36.839239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4a96-af73-4a79-a6de-6ba9cb574f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:36.839504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4a96-af73-4a79-a6de-6ba9cb574f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:36.848876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af4a96-af73-4a79-a6de-6ba9cb574f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:36.850301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af4a96-af73-4a79-a6de-6ba9cb574f15 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:36.860458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1166/2316] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:37.086744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e946f-1957-4812-b418-728248bc5e3f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:37.097183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e946f-1957-4812-b418-728248bc5e3f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:37.104329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49828-b72d-455d-9ef0-d50f484e208d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:37.104329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49828-b72d-455d-9ef0-d50f484e208d service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:37.104329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49828-b72d-455d-9ef0-d50f484e208d service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:37.104329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49828-b72d-455d-9ef0-d50f484e208d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:37.159927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49828-b72d-455d-9ef0-d50f484e208d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:37.161522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49828-b72d-455d-9ef0-d50f484e208d service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:37.170649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1151/2317] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:46.856030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=18 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:47.166524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:50.852112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af4a96-af73-4a79-a6de-6ba9cb574f15 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:50.913194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af4a96-af73-4a79-a6de-6ba9cb574f15 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:50.917712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:50.918327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:50.918639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:50.918907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] PATH_INFO: `/v3/users/403af7a2b6894bb5afba2b74b69c195d` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:50.920014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=403af7a2b6894bb5afba2b74b69c195d)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:50.921966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:51.083174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403af7a2b6894bb5afba2b74b69c195d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:51.089899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403af7a2b6894bb5afba2b74b69c195d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:51.154834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403af7a2b6894bb5afba2b74b69c195d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:51.155476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403af7a2b6894bb5afba2b74b69c195d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:51.167368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403af7a2b6894bb5afba2b74b69c195d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:51.173664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1167/2318] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:50 2022] DELETE /identity/v3/users/403af7a2b6894bb5afba2b74b69c195d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:51.178311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaadafd-1529-4a04-9b3b-03a4ac68a7f5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:51.178846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaadafd-1529-4a04-9b3b-03a4ac68a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:51.178947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaadafd-1529-4a04-9b3b-03a4ac68a7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:51.198073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-baaadafd-1529-4a04-9b3b-03a4ac68a7f5 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:51.199302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-baaadafd-1529-4a04-9b3b-03a4ac68a7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:51.256533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1152/2319] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:51.266728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:51.268104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:51.324525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd947374-df93-4e87-bf6e-48f6a1a05f7c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:51.328151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780c4ee-d988-46d8-aafd-530cb5fed1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:51.328740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780c4ee-d988-46d8-aafd-530cb5fed1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:51.329012 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780c4ee-d988-46d8-aafd-530cb5fed1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:51.329277 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780c4ee-d988-46d8-aafd-530cb5fed1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:51.338085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780c4ee-d988-46d8-aafd-530cb5fed1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:51.339466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780c4ee-d988-46d8-aafd-530cb5fed1a8 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:51.348582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1168/2320] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:51.780095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaadafd-1529-4a04-9b3b-03a4ac68a7f5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:51.781555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-baaadafd-1529-4a04-9b3b-03a4ac68a7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:51.794084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaadafd-1529-4a04-9b3b-03a4ac68a7f5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:51.799679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:51.800315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:51.800592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:51.800871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] PATH_INFO: `/v3/projects/9bb14cd6272b445c86a27e6eeb561cd4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:51.802022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb14cd6272b445c86a27e6eeb561cd4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:51.803973 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:51.935325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb14cd6272b445c86a27e6eeb561cd4', 'request_id': 'req-9b5f33da-3755-4a08-a130-6ffe24cc2465'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.023759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb14cd6272b445c86a27e6eeb561cd4', 'request_id': 'req-9b5f33da-3755-4a08-a130-6ffe24cc2465'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.030603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb14cd6272b445c86a27e6eeb561cd4', 'request_id': 'req-9b5f33da-3755-4a08-a130-6ffe24cc2465'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.041602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] The token cache is being invalidate because project 9bb14cd6272b445c86a27e6eeb561cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:52.041885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.042528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.044014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1153/2321] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:51 2022] DELETE /identity/v3/projects/9bb14cd6272b445c86a27e6eeb561cd4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:52.048190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780c4ee-d988-46d8-aafd-530cb5fed1a8 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:52.057798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780c4ee-d988-46d8-aafd-530cb5fed1a8 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:52.076012 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:52.115313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:52.115932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:52.116206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:52.116482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] PATH_INFO: `/v3/users/df9d8b87ffb6422ba0ffc715e3531e25` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:52.117584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9d8b87ffb6422ba0ffc715e3531e25)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:52.119809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:52.339894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9d8b87ffb6422ba0ffc715e3531e25'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.346848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9d8b87ffb6422ba0ffc715e3531e25'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.400913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9d8b87ffb6422ba0ffc715e3531e25'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.401529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9d8b87ffb6422ba0ffc715e3531e25'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.413861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ab93c1cf-77df-4ab8-ae08-81ff023819ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9d8b87ffb6422ba0ffc715e3531e25'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:52.421060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1169/2322] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:52 2022] DELETE /identity/v3/users/df9d8b87ffb6422ba0ffc715e3531e25 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:52.879812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:52.881288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:52.896708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f33da-3755-4a08-a130-6ffe24cc2465 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:52.960443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:52.961075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:52.961351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:52.961624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] PATH_INFO: `/v3/projects/7379fdeb6c1142b59e315553a7267867` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:52.962780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7379fdeb6c1142b59e315553a7267867)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:52.964715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:53.060329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:53.076863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7379fdeb6c1142b59e315553a7267867', 'request_id': 'req-be1ed464-261d-4174-bb61-121921eb5fdd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:53.144182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7379fdeb6c1142b59e315553a7267867', 'request_id': 'req-be1ed464-261d-4174-bb61-121921eb5fdd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:53.151271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7379fdeb6c1142b59e315553a7267867', 'request_id': 'req-be1ed464-261d-4174-bb61-121921eb5fdd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:53.162286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] The token cache is being invalidate because project 7379fdeb6c1142b59e315553a7267867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:53.162547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:53.163192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-be1ed464-261d-4174-bb61-121921eb5fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:53.164709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1154/2323] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:52 2022] DELETE /identity/v3/projects/7379fdeb6c1142b59e315553a7267867 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:53.169769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844658c0-aa45-42d6-b71d-089ff2d126d8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.170310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844658c0-aa45-42d6-b71d-089ff2d126d8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.170310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844658c0-aa45-42d6-b71d-089ff2d126d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:53.190084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-844658c0-aa45-42d6-b71d-089ff2d126d8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:53.191435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-844658c0-aa45-42d6-b71d-089ff2d126d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:53.250973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1170/2324] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:53.258720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63929-4ee2-48b1-b42a-2e1aa6430563 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.259003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63929-4ee2-48b1-b42a-2e1aa6430563 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.259278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63929-4ee2-48b1-b42a-2e1aa6430563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:53.278564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-29d63929-4ee2-48b1-b42a-2e1aa6430563 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:53.279761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-29d63929-4ee2-48b1-b42a-2e1aa6430563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:53.288596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1155/2325] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:53.292837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844658c0-aa45-42d6-b71d-089ff2d126d8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:53.303165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844658c0-aa45-42d6-b71d-089ff2d126d8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:53.307798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:53.308385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.308664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.308931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:53.309569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:48:53.309873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:53.311504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:53.323113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1171/2326] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:48:53.327427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d63929-4ee2-48b1-b42a-2e1aa6430563 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:53.337306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d63929-4ee2-48b1-b42a-2e1aa6430563 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:53.342043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98f83-c1f8-487e-a0b3-26df6905d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:53.342782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98f83-c1f8-487e-a0b3-26df6905d646 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.343118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98f83-c1f8-487e-a0b3-26df6905d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.343446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98f83-c1f8-487e-a0b3-26df6905d646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:53.344145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98f83-c1f8-487e-a0b3-26df6905d646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:53.346551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98f83-c1f8-487e-a0b3-26df6905d646 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:53.536975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1156/2327] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:48:53 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:53.554589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:53.565780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed30618-0165-442f-9098-a5b5eea44cab admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:53.594035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:53.627089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892466e9-3b9f-4f28-960b-6c5f1942c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:53.627719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892466e9-3b9f-4f28-960b-6c5f1942c4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.627998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892466e9-3b9f-4f28-960b-6c5f1942c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.628330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892466e9-3b9f-4f28-960b-6c5f1942c4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:53.628929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892466e9-3b9f-4f28-960b-6c5f1942c4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:53.630857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892466e9-3b9f-4f28-960b-6c5f1942c4a9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:53.745086 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1172/2328] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:48:53 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:53.749132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98f83-c1f8-487e-a0b3-26df6905d646 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:53.761314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98f83-c1f8-487e-a0b3-26df6905d646 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:53.767475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6ce07-c6f3-4f92-95d2-dfb29f20a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:53.768173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ce07-c6f3-4f92-95d2-dfb29f20a8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.768536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ce07-c6f3-4f92-95d2-dfb29f20a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.768887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ce07-c6f3-4f92-95d2-dfb29f20a8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:53.769732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6ce07-c6f3-4f92-95d2-dfb29f20a8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:53.771626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6ce07-c6f3-4f92-95d2-dfb29f20a8fb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:53.783461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1157/2329] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:53.787518 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892466e9-3b9f-4f28-960b-6c5f1942c4a9 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:53.798169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892466e9-3b9f-4f28-960b-6c5f1942c4a9 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:53.803034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a186f0-3544-4e9d-a5dd-847e03ac4f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:53.803743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a186f0-3544-4e9d-a5dd-847e03ac4f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.804080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a186f0-3544-4e9d-a5dd-847e03ac4f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.804417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a186f0-3544-4e9d-a5dd-847e03ac4f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:53.805132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a186f0-3544-4e9d-a5dd-847e03ac4f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:53.806855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a186f0-3544-4e9d-a5dd-847e03ac4f0c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:53.818336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1173/2330] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:53.822522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6ce07-c6f3-4f92-95d2-dfb29f20a8fb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:53.833407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6ce07-c6f3-4f92-95d2-dfb29f20a8fb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:53.838365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512120-8ea2-484b-8ada-ab35db11c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:53.840199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512120-8ea2-484b-8ada-ab35db11c610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.840692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512120-8ea2-484b-8ada-ab35db11c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.841036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512120-8ea2-484b-8ada-ab35db11c610 admin admin] PATH_INFO: `/v3/projects/89d645318ba043939b6e4bb5b53ac744/users/17329edb052940428a415e4fe026c4fa/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:53.867041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92512120-8ea2-484b-8ada-ab35db11c610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d645318ba043939b6e4bb5b53ac744, user_id=17329edb052940428a415e4fe026c4fa, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:53.869237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92512120-8ea2-484b-8ada-ab35db11c610 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:53.988188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1158/2331] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:53 2022] PUT /identity/v3/projects/89d645318ba043939b6e4bb5b53ac744/users/17329edb052940428a415e4fe026c4fa/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:53.998682 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454143f-fdf3-49a2-93cd-6eadebd004c1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:53.998973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454143f-fdf3-49a2-93cd-6eadebd004c1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:53.999248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454143f-fdf3-49a2-93cd-6eadebd004c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.035670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9454143f-fdf3-49a2-93cd-6eadebd004c1 None None] MFA Rules not processed for user `17329edb052940428a415e4fe026c4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:54.035670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9454143f-fdf3-49a2-93cd-6eadebd004c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:54.121421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1174/2332] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:54.125991 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512120-8ea2-484b-8ada-ab35db11c610 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:54.193278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512120-8ea2-484b-8ada-ab35db11c610 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:54.198028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba2d0-566d-4caa-915f-552be4ca5e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:54.198669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba2d0-566d-4caa-915f-552be4ca5e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:54.198945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba2d0-566d-4caa-915f-552be4ca5e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:54.199212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba2d0-566d-4caa-915f-552be4ca5e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.199839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aba2d0-566d-4caa-915f-552be4ca5e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:54.201778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aba2d0-566d-4caa-915f-552be4ca5e7c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:54.305531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1159/2333] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:48:54 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:54.306808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454143f-fdf3-49a2-93cd-6eadebd004c1 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:54.317974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454143f-fdf3-49a2-93cd-6eadebd004c1 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:54.377474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eed0c4-4c45-4cab-9bd7-ca5c3deb11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:54.378003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eed0c4-4c45-4cab-9bd7-ca5c3deb11dc admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:54.378288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eed0c4-4c45-4cab-9bd7-ca5c3deb11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:54.378588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eed0c4-4c45-4cab-9bd7-ca5c3deb11dc admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.379306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eed0c4-4c45-4cab-9bd7-ca5c3deb11dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:54.381211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eed0c4-4c45-4cab-9bd7-ca5c3deb11dc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:54.484344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1175/2334] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:48:54 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:54.488266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba2d0-566d-4caa-915f-552be4ca5e7c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:54.498801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba2d0-566d-4caa-915f-552be4ca5e7c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:54.503836 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab689a-228d-430d-bb7e-1f800014f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:54.504432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab689a-228d-430d-bb7e-1f800014f310 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:54.504708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab689a-228d-430d-bb7e-1f800014f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:54.504979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab689a-228d-430d-bb7e-1f800014f310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.505616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab689a-228d-430d-bb7e-1f800014f310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:54.507248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab689a-228d-430d-bb7e-1f800014f310 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:54.518783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1160/2335] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:54.526359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eed0c4-4c45-4cab-9bd7-ca5c3deb11dc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:54.538888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eed0c4-4c45-4cab-9bd7-ca5c3deb11dc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:54.541626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9076cfb-6130-4081-940b-0c4f7b8b6912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:54.542421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9076cfb-6130-4081-940b-0c4f7b8b6912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:54.543965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9076cfb-6130-4081-940b-0c4f7b8b6912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:54.543965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9076cfb-6130-4081-940b-0c4f7b8b6912 admin admin] PATH_INFO: `/v3/projects/f8a7e001eddf4ca7bffd3219cb8f5a1c/users/2c41cc75d99747a7af98bf43c1855922/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.559644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9076cfb-6130-4081-940b-0c4f7b8b6912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a7e001eddf4ca7bffd3219cb8f5a1c, user_id=2c41cc75d99747a7af98bf43c1855922, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:54.563675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9076cfb-6130-4081-940b-0c4f7b8b6912 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:54.636850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1176/2336] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:54 2022] PUT /identity/v3/projects/f8a7e001eddf4ca7bffd3219cb8f5a1c/users/2c41cc75d99747a7af98bf43c1855922/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:54.640821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab689a-228d-430d-bb7e-1f800014f310 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:54.651988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab689a-228d-430d-bb7e-1f800014f310 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:54.672205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:54.711188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc02bc-dadf-4b7c-9978-c2621b56e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:54.712158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc02bc-dadf-4b7c-9978-c2621b56e8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:54.712158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc02bc-dadf-4b7c-9978-c2621b56e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:54.712494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc02bc-dadf-4b7c-9978-c2621b56e8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.713150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc02bc-dadf-4b7c-9978-c2621b56e8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:54.714839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc02bc-dadf-4b7c-9978-c2621b56e8e8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:54.725834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1161/2337] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:54.729954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9076cfb-6130-4081-940b-0c4f7b8b6912 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:54.735745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:54.741424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9076cfb-6130-4081-940b-0c4f7b8b6912 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:54.746281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:54.747006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:54.747297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:54.747572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] PATH_INFO: `/v3/projects/f8a7e001eddf4ca7bffd3219cb8f5a1c/users/2c41cc75d99747a7af98bf43c1855922/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.749474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a7e001eddf4ca7bffd3219cb8f5a1c, user_id=2c41cc75d99747a7af98bf43c1855922, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:54.752793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:54.763623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1177/2338] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:54 2022] PUT /identity/v3/projects/f8a7e001eddf4ca7bffd3219cb8f5a1c/users/2c41cc75d99747a7af98bf43c1855922/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:54.778370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff35f-fcfc-4a21-aadb-e3bde35c21b2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:54.778708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff35f-fcfc-4a21-aadb-e3bde35c21b2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:54.779004 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff35f-fcfc-4a21-aadb-e3bde35c21b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.808024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d69ff35f-fcfc-4a21-aadb-e3bde35c21b2 None None] MFA Rules not processed for user `2c41cc75d99747a7af98bf43c1855922`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:54.809244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d69ff35f-fcfc-4a21-aadb-e3bde35c21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:54.883124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1162/2339] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:48:54.894537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:54.896333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:54.970550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f028e-dd1b-4504-8e58-09eb3c68c3e9 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:54.974353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30204b-cfc1-48d5-be9a-7f1271efc7e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:54.975000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30204b-cfc1-48d5-be9a-7f1271efc7e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:54.975267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30204b-cfc1-48d5-be9a-7f1271efc7e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:54.975535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30204b-cfc1-48d5-be9a-7f1271efc7e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:54.985701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30204b-cfc1-48d5-be9a-7f1271efc7e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:54.987638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30204b-cfc1-48d5-be9a-7f1271efc7e7 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:54.996998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1178/2340] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:55.949741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff35f-fcfc-4a21-aadb-e3bde35c21b2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:56.011122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff35f-fcfc-4a21-aadb-e3bde35c21b2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:56.015646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:56.016892 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:56.017184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:56.017458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] PATH_INFO: `/v3/users/17329edb052940428a415e4fe026c4fa` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:56.018624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17329edb052940428a415e4fe026c4fa)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:56.020540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:56.231571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17329edb052940428a415e4fe026c4fa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:56.233242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:56.313887 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17329edb052940428a415e4fe026c4fa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:56.318036 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0b2df-6eba-4e4f-b4e7-84c0f85e7fe7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:56.318535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0b2df-6eba-4e4f-b4e7-84c0f85e7fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:56.318635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0b2df-6eba-4e4f-b4e7-84c0f85e7fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:56.321665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17329edb052940428a415e4fe026c4fa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:56.334667 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17329edb052940428a415e4fe026c4fa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:56.338544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bb3c7d6b-9e84-4ac1-bfc9-5e716c23ebf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17329edb052940428a415e4fe026c4fa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:56.338675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bca0b2df-6eba-4e4f-b4e7-84c0f85e7fe7 None None] MFA Rules not processed for user `f1c7a90e90e5411f92eddd180ef9e27d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:56.339293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bca0b2df-6eba-4e4f-b4e7-84c0f85e7fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:56.341713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1163/2341] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:55 2022] DELETE /identity/v3/users/17329edb052940428a415e4fe026c4fa => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:56.346035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b562-7fc2-4c4b-a1b5-54a827d09bd8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:56.346317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b562-7fc2-4c4b-a1b5-54a827d09bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:56.346621 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b562-7fc2-4c4b-a1b5-54a827d09bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:56.365459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4e56b562-7fc2-4c4b-a1b5-54a827d09bd8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:56.366691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4e56b562-7fc2-4c4b-a1b5-54a827d09bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:56.397079 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1179/2342] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:48:56.430237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1164/2343] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:56.440565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0b2df-6eba-4e4f-b4e7-84c0f85e7fe7 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:56.442024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bca0b2df-6eba-4e4f-b4e7-84c0f85e7fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:56.503707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0b2df-6eba-4e4f-b4e7-84c0f85e7fe7 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:56.507632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd0c2c-6126-40ce-8fcf-849faa5811be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:56.508273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0c2c-6126-40ce-8fcf-849faa5811be service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:56.508551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0c2c-6126-40ce-8fcf-849faa5811be service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:56.508823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd0c2c-6126-40ce-8fcf-849faa5811be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:56.518060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd0c2c-6126-40ce-8fcf-849faa5811be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:56.529983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd0c2c-6126-40ce-8fcf-849faa5811be service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:56.529983 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1180/2344] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:48:57.095167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56b562-7fc2-4c4b-a1b5-54a827d09bd8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:57.097222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4e56b562-7fc2-4c4b-a1b5-54a827d09bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:57.111206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56b562-7fc2-4c4b-a1b5-54a827d09bd8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:57.116464 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:57.117378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:57.117822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:57.118247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] PATH_INFO: `/v3/projects/89d645318ba043939b6e4bb5b53ac744` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:57.119811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d645318ba043939b6e4bb5b53ac744)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:57.121918 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:57.239541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d645318ba043939b6e4bb5b53ac744', 'request_id': 'req-886b3c31-b553-4374-b168-6e3a8680b0e3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.309398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d645318ba043939b6e4bb5b53ac744', 'request_id': 'req-886b3c31-b553-4374-b168-6e3a8680b0e3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.316259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d645318ba043939b6e4bb5b53ac744', 'request_id': 'req-886b3c31-b553-4374-b168-6e3a8680b0e3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.327188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] The token cache is being invalidate because project 89d645318ba043939b6e4bb5b53ac744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:57.327592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.328244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.330490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1165/2345] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:57 2022] DELETE /identity/v3/projects/89d645318ba043939b6e4bb5b53ac744 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:57.334242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd0c2c-6126-40ce-8fcf-849faa5811be service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:57.345489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd0c2c-6126-40ce-8fcf-849faa5811be service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:57.382919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:57.401354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:57.404475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:57.404475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:57.404475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] PATH_INFO: `/v3/users/2c41cc75d99747a7af98bf43c1855922` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:57.404475 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c41cc75d99747a7af98bf43c1855922)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:57.405520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:57.579632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c41cc75d99747a7af98bf43c1855922'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.586368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c41cc75d99747a7af98bf43c1855922'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.666323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c41cc75d99747a7af98bf43c1855922'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.667493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c41cc75d99747a7af98bf43c1855922'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.680206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-34666177-545d-4961-b36a-2d468f801919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c41cc75d99747a7af98bf43c1855922'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:57.686798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1181/2346] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:48:57 2022] DELETE /identity/v3/users/2c41cc75d99747a7af98bf43c1855922 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:58.138935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:58.141015 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:58.154555 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b3c31-b553-4374-b168-6e3a8680b0e3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:58.202080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:58.218198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:58.218982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:58.219359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:58.219741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] PATH_INFO: `/v3/projects/f8a7e001eddf4ca7bffd3219cb8f5a1c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:58.220983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a7e001eddf4ca7bffd3219cb8f5a1c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:58.223043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:58.315078 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a7e001eddf4ca7bffd3219cb8f5a1c', 'request_id': 'req-41a0f275-9901-4640-9bb1-c948c5e73fa3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:58.420158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a7e001eddf4ca7bffd3219cb8f5a1c', 'request_id': 'req-41a0f275-9901-4640-9bb1-c948c5e73fa3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:58.427553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a7e001eddf4ca7bffd3219cb8f5a1c', 'request_id': 'req-41a0f275-9901-4640-9bb1-c948c5e73fa3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:58.438290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] The token cache is being invalidate because project f8a7e001eddf4ca7bffd3219cb8f5a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:48:58.438770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:58.439412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41a0f275-9901-4640-9bb1-c948c5e73fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:48:58.441014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1166/2347] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:48:58 2022] DELETE /identity/v3/projects/f8a7e001eddf4ca7bffd3219cb8f5a1c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:58.445916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ec3f-69e0-4a72-98a3-4ef6de7b3fa3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:58.446408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ec3f-69e0-4a72-98a3-4ef6de7b3fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:58.446554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ec3f-69e0-4a72-98a3-4ef6de7b3fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:58.467262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-29f6ec3f-69e0-4a72-98a3-4ef6de7b3fa3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:58.468496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-29f6ec3f-69e0-4a72-98a3-4ef6de7b3fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:58.529066 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1182/2348] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:58.538611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803318f3-f08c-491f-9adf-53d23fc134c8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:58.538924 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803318f3-f08c-491f-9adf-53d23fc134c8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:58.539196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803318f3-f08c-491f-9adf-53d23fc134c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:58.559314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-803318f3-f08c-491f-9adf-53d23fc134c8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:58.566681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-803318f3-f08c-491f-9adf-53d23fc134c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:58.568510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1167/2349] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:58.572745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ec3f-69e0-4a72-98a3-4ef6de7b3fa3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:58.582776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ec3f-69e0-4a72-98a3-4ef6de7b3fa3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:58.587433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:58.588014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:58.588283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:58.588544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:58.589180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:48:58.589474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:58.591138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:58.603920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1183/2350] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:48:58.610868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803318f3-f08c-491f-9adf-53d23fc134c8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:58.620229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803318f3-f08c-491f-9adf-53d23fc134c8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:58.625092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c0022-4d25-44c3-8a4d-98e0cc538598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:58.626148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c0022-4d25-44c3-8a4d-98e0cc538598 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:58.626515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c0022-4d25-44c3-8a4d-98e0cc538598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:58.626789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c0022-4d25-44c3-8a4d-98e0cc538598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:58.627432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c0022-4d25-44c3-8a4d-98e0cc538598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:58.629331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c0022-4d25-44c3-8a4d-98e0cc538598 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:58.747570 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1168/2351] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:48:58 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:58.751631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:58.761796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfc148-00a7-4af0-b355-ebf0f0b5dd9a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:58.806040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:58.818629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10490012-91fa-498b-b561-0ce091f3fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:58.819231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490012-91fa-498b-b561-0ce091f3fd7f admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:58.819513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490012-91fa-498b-b561-0ce091f3fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:58.819899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490012-91fa-498b-b561-0ce091f3fd7f admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:58.820555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10490012-91fa-498b-b561-0ce091f3fd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:58.822525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10490012-91fa-498b-b561-0ce091f3fd7f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:58.941688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1184/2352] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:48:58 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:48:58.943104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c0022-4d25-44c3-8a4d-98e0cc538598 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:58.956372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c0022-4d25-44c3-8a4d-98e0cc538598 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:58.961145 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe868b-c7b9-4d99-9330-4f588e190535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:58.962181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe868b-c7b9-4d99-9330-4f588e190535 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:58.962324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe868b-c7b9-4d99-9330-4f588e190535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:58.962673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe868b-c7b9-4d99-9330-4f588e190535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:58.963390 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe868b-c7b9-4d99-9330-4f588e190535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:58.964996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe868b-c7b9-4d99-9330-4f588e190535 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:58.976230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1169/2353] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:58.985164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10490012-91fa-498b-b561-0ce091f3fd7f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:59.011197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10490012-91fa-498b-b561-0ce091f3fd7f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:59.011197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b336-421a-444d-8091-db7f94a50f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:59.011197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b336-421a-444d-8091-db7f94a50f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.011197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b336-421a-444d-8091-db7f94a50f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.011641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b336-421a-444d-8091-db7f94a50f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.011641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b336-421a-444d-8091-db7f94a50f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:59.011641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b336-421a-444d-8091-db7f94a50f24 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:59.015429 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1185/2354] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:59.020379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe868b-c7b9-4d99-9330-4f588e190535 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:59.030738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe868b-c7b9-4d99-9330-4f588e190535 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:59.035469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031966-02b7-4b2b-ae43-49175949f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:59.038675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031966-02b7-4b2b-ae43-49175949f261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.038675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031966-02b7-4b2b-ae43-49175949f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.038675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031966-02b7-4b2b-ae43-49175949f261 admin admin] PATH_INFO: `/v3/projects/4841775642864de2b0917761b9bde018/users/199c144dc802442cb524803cd259decd/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.051020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00031966-02b7-4b2b-ae43-49175949f261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4841775642864de2b0917761b9bde018, user_id=199c144dc802442cb524803cd259decd, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:59.053664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00031966-02b7-4b2b-ae43-49175949f261 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:59.150216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1170/2355] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:59 2022] PUT /identity/v3/projects/4841775642864de2b0917761b9bde018/users/199c144dc802442cb524803cd259decd/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:59.160349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c2fb-f165-4823-a14a-7dffe1c2ffd6 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.160633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c2fb-f165-4823-a14a-7dffe1c2ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.160905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c2fb-f165-4823-a14a-7dffe1c2ffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.189354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8cf9c2fb-f165-4823-a14a-7dffe1c2ffd6 None None] MFA Rules not processed for user `199c144dc802442cb524803cd259decd`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:59.190680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8cf9c2fb-f165-4823-a14a-7dffe1c2ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:48:59.255161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1186/2356] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:48:59.259633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031966-02b7-4b2b-ae43-49175949f261 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:59.321751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031966-02b7-4b2b-ae43-49175949f261 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:59.326298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50cb73-99b6-44a2-a614-ebbd1f3a8fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:59.326939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50cb73-99b6-44a2-a614-ebbd1f3a8fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.327305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50cb73-99b6-44a2-a614-ebbd1f3a8fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.327579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50cb73-99b6-44a2-a614-ebbd1f3a8fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.328200 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50cb73-99b6-44a2-a614-ebbd1f3a8fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:59.330643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50cb73-99b6-44a2-a614-ebbd1f3a8fe7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:59.427093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:59.433691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1171/2357] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:48:59 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:59.437550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c2fb-f165-4823-a14a-7dffe1c2ffd6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:59.448885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c2fb-f165-4823-a14a-7dffe1c2ffd6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:59.505944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb1c4-ce7d-4767-bbb8-56540a6166de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:59.506578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb1c4-ce7d-4767-bbb8-56540a6166de admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.506906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb1c4-ce7d-4767-bbb8-56540a6166de admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.507180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb1c4-ce7d-4767-bbb8-56540a6166de admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.507810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb1c4-ce7d-4767-bbb8-56540a6166de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:59.509710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb1c4-ce7d-4767-bbb8-56540a6166de admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:59.669611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1187/2358] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:48:59 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:48:59.673984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50cb73-99b6-44a2-a614-ebbd1f3a8fe7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:59.684843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50cb73-99b6-44a2-a614-ebbd1f3a8fe7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:59.690102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee90b-86af-4278-9263-5a7000b11e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:59.690726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee90b-86af-4278-9263-5a7000b11e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.691002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee90b-86af-4278-9263-5a7000b11e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.691273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee90b-86af-4278-9263-5a7000b11e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.691906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee90b-86af-4278-9263-5a7000b11e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:59.693544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee90b-86af-4278-9263-5a7000b11e95 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:59.703961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1172/2359] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:59.708000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb1c4-ce7d-4767-bbb8-56540a6166de admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:59.717820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb1c4-ce7d-4767-bbb8-56540a6166de admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:59.723038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398baf87-e896-4824-9953-ea66af23ca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:59.723683 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398baf87-e896-4824-9953-ea66af23ca08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.723964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398baf87-e896-4824-9953-ea66af23ca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.724237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398baf87-e896-4824-9953-ea66af23ca08 admin admin] PATH_INFO: `/v3/projects/237af3d4c024416f94318920957811bc/users/306b9773c6a943c4ba0671badc0a4de1/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.739603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398baf87-e896-4824-9953-ea66af23ca08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237af3d4c024416f94318920957811bc, user_id=306b9773c6a943c4ba0671badc0a4de1, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:59.742262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398baf87-e896-4824-9953-ea66af23ca08 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:59.812943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1188/2360] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:59 2022] PUT /identity/v3/projects/237af3d4c024416f94318920957811bc/users/306b9773c6a943c4ba0671badc0a4de1/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:59.817073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee90b-86af-4278-9263-5a7000b11e95 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:59.827140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee90b-86af-4278-9263-5a7000b11e95 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:59.881862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fe267-fdaf-4a35-8d98-daf5cd98cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:59.882523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fe267-fdaf-4a35-8d98-daf5cd98cf60 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.882802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fe267-fdaf-4a35-8d98-daf5cd98cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.883074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fe267-fdaf-4a35-8d98-daf5cd98cf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.883735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fe267-fdaf-4a35-8d98-daf5cd98cf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:59.885354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fe267-fdaf-4a35-8d98-daf5cd98cf60 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:59.895087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1173/2361] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:48:59.899352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398baf87-e896-4824-9953-ea66af23ca08 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:48:59.911642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398baf87-e896-4824-9953-ea66af23ca08 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:48:59.915175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:48:59.915862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.916135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.916401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] PATH_INFO: `/v3/projects/237af3d4c024416f94318920957811bc/users/306b9773c6a943c4ba0671badc0a4de1/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.918487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237af3d4c024416f94318920957811bc, user_id=306b9773c6a943c4ba0671badc0a4de1, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:48:59.921199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:48:59.932457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1189/2362] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:48:59 2022] PUT /identity/v3/projects/237af3d4c024416f94318920957811bc/users/306b9773c6a943c4ba0671badc0a4de1/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:48:59.942771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e56ef-b46b-41a7-8556-f8f67498ef8b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:48:59.943060 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e56ef-b46b-41a7-8556-f8f67498ef8b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:48:59.943339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e56ef-b46b-41a7-8556-f8f67498ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:48:59.972249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-689e56ef-b46b-41a7-8556-f8f67498ef8b None None] MFA Rules not processed for user `306b9773c6a943c4ba0671badc0a4de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:48:59.973460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-689e56ef-b46b-41a7-8556-f8f67498ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:00.048422 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1174/2363] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:00.060101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:00.062460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:00.073370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:00.136206 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d857-1e1c-4805-9256-e2c4c4f84bf0 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:00.140301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e22ffd-0f8e-4bd2-815e-0a5c0f4fead9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:00.141986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22ffd-0f8e-4bd2-815e-0a5c0f4fead9 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:00.141986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22ffd-0f8e-4bd2-815e-0a5c0f4fead9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:00.142246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22ffd-0f8e-4bd2-815e-0a5c0f4fead9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:00.153275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e22ffd-0f8e-4bd2-815e-0a5c0f4fead9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:00.154850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e22ffd-0f8e-4bd2-815e-0a5c0f4fead9 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:00.166353 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1190/2364] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:49:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:49:01.548384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e56ef-b46b-41a7-8556-f8f67498ef8b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:01.607496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e56ef-b46b-41a7-8556-f8f67498ef8b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:01.613095 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:01.613729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:01.614003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:01.614268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] PATH_INFO: `/v3/users/199c144dc802442cb524803cd259decd` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:01.615444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=199c144dc802442cb524803cd259decd)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:01.617382 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:01.629729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:01.855165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199c144dc802442cb524803cd259decd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:01.960811 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199c144dc802442cb524803cd259decd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:01.968788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199c144dc802442cb524803cd259decd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:01.982108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199c144dc802442cb524803cd259decd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:01.982832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199c144dc802442cb524803cd259decd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:01.988668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1175/2365] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:49:01 2022] DELETE /identity/v3/users/199c144dc802442cb524803cd259decd => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:49:01.993034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36129f2e-2595-47f1-8807-bef7ca13728d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:01.993492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36129f2e-2595-47f1-8807-bef7ca13728d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:01.993593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36129f2e-2595-47f1-8807-bef7ca13728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:02.012088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-36129f2e-2595-47f1-8807-bef7ca13728d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:49:02.013276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-36129f2e-2595-47f1-8807-bef7ca13728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:02.073698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1191/2366] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:02.085614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:02.087074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:02.145453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500148f-6a1a-446c-8cc6-9e9a2d53d47a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:02.149085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acc32c-3044-40c6-8549-00b6ee013fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:02.149975 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acc32c-3044-40c6-8549-00b6ee013fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:02.150252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acc32c-3044-40c6-8549-00b6ee013fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:02.150552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acc32c-3044-40c6-8549-00b6ee013fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:02.159483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acc32c-3044-40c6-8549-00b6ee013fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:02.160925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acc32c-3044-40c6-8549-00b6ee013fc5 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:02.170651 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1176/2367] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:49:02.785799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36129f2e-2595-47f1-8807-bef7ca13728d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:02.787264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-36129f2e-2595-47f1-8807-bef7ca13728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:02.799838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36129f2e-2595-47f1-8807-bef7ca13728d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:02.804405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:02.805033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:02.805309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:02.805585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] PATH_INFO: `/v3/projects/4841775642864de2b0917761b9bde018` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:02.806723 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4841775642864de2b0917761b9bde018)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:02.808626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:02.910431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4841775642864de2b0917761b9bde018', 'request_id': 'req-a88838bf-8ca9-4e32-b8af-2afc6a215e00'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:02.915923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4841775642864de2b0917761b9bde018', 'request_id': 'req-a88838bf-8ca9-4e32-b8af-2afc6a215e00'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:02.922076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4841775642864de2b0917761b9bde018', 'request_id': 'req-a88838bf-8ca9-4e32-b8af-2afc6a215e00'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:03.011540 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] The token cache is being invalidate because project 4841775642864de2b0917761b9bde018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:49:03.012072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:03.012487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:03.014021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1192/2368] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:49:02 2022] DELETE /identity/v3/projects/4841775642864de2b0917761b9bde018 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:49:03.018009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acc32c-3044-40c6-8549-00b6ee013fc5 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:03.028128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acc32c-3044-40c6-8549-00b6ee013fc5 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:03.083118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:03.083735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:03.084011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:03.084316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] PATH_INFO: `/v3/users/306b9773c6a943c4ba0671badc0a4de1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:03.085438 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306b9773c6a943c4ba0671badc0a4de1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:03.087412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:03.262730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:03.272540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306b9773c6a943c4ba0671badc0a4de1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:03.343516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306b9773c6a943c4ba0671badc0a4de1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:03.351269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306b9773c6a943c4ba0671badc0a4de1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:03.363386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306b9773c6a943c4ba0671badc0a4de1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:03.364039 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ee38eec4-6b8e-4df5-84dc-f79da979fab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306b9773c6a943c4ba0671badc0a4de1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:03.369922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1177/2369] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:49:03 2022] DELETE /identity/v3/users/306b9773c6a943c4ba0671badc0a4de1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:49:03.808175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:03.809816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:03.841404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88838bf-8ca9-4e32-b8af-2afc6a215e00 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:03.874112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:03.901171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:03.901802 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:03.902083 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:03.902354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] PATH_INFO: `/v3/projects/237af3d4c024416f94318920957811bc` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:03.903514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237af3d4c024416f94318920957811bc)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:03.905462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:04.043931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237af3d4c024416f94318920957811bc', 'request_id': 'req-e4c62b68-6d92-449a-9fc9-f8778f0f9346'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:04.049377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237af3d4c024416f94318920957811bc', 'request_id': 'req-e4c62b68-6d92-449a-9fc9-f8778f0f9346'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:04.055685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237af3d4c024416f94318920957811bc', 'request_id': 'req-e4c62b68-6d92-449a-9fc9-f8778f0f9346'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:04.114451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] The token cache is being invalidate because project 237af3d4c024416f94318920957811bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:49:04.114762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:04.115375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-e4c62b68-6d92-449a-9fc9-f8778f0f9346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:04.116860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1193/2370] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:49:03 2022] DELETE /identity/v3/projects/237af3d4c024416f94318920957811bc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:49:04.121735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c528ae-7405-4c3b-9267-3a24d356d50c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.122198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c528ae-7405-4c3b-9267-3a24d356d50c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.122309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c528ae-7405-4c3b-9267-3a24d356d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.141810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-83c528ae-7405-4c3b-9267-3a24d356d50c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:49:04.143061 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-83c528ae-7405-4c3b-9267-3a24d356d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:04.200628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1178/2371] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:04.209027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32442e-ec4f-493f-89a9-b1f3bcd610dd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.209324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32442e-ec4f-493f-89a9-b1f3bcd610dd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.209582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32442e-ec4f-493f-89a9-b1f3bcd610dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.229489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bd32442e-ec4f-493f-89a9-b1f3bcd610dd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:49:04.230742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bd32442e-ec4f-493f-89a9-b1f3bcd610dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:04.238626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1194/2372] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:04.242731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c528ae-7405-4c3b-9267-3a24d356d50c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:04.252937 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c528ae-7405-4c3b-9267-3a24d356d50c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:04.257531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:04.258125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.258421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.258711 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.259366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:49:04.259668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:04.261295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:04.273432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1179/2373] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:49:04.277739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32442e-ec4f-493f-89a9-b1f3bcd610dd None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:04.288441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32442e-ec4f-493f-89a9-b1f3bcd610dd None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:04.293118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359d4f-3f4b-4899-920c-e5ced02a1a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:04.293714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359d4f-3f4b-4899-920c-e5ced02a1a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.293993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359d4f-3f4b-4899-920c-e5ced02a1a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.294264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359d4f-3f4b-4899-920c-e5ced02a1a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.294919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359d4f-3f4b-4899-920c-e5ced02a1a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:04.296827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359d4f-3f4b-4899-920c-e5ced02a1a4a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:04.379415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1195/2374] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:49:04 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:49:04.383450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:04.394165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4ac0a-94f0-4c40-af98-5165e7be6b5f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:04.448292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0fe76-fc46-4ee4-8258-d6b9b22b13dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:04.448882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0fe76-fc46-4ee4-8258-d6b9b22b13dd admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.449155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0fe76-fc46-4ee4-8258-d6b9b22b13dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.449436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0fe76-fc46-4ee4-8258-d6b9b22b13dd admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.450036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0fe76-fc46-4ee4-8258-d6b9b22b13dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:04.451965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0fe76-fc46-4ee4-8258-d6b9b22b13dd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:04.572494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1180/2375] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:49:04 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:49:04.576741 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359d4f-3f4b-4899-920c-e5ced02a1a4a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:04.587548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359d4f-3f4b-4899-920c-e5ced02a1a4a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:04.592151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524f80-6c14-43b5-9a93-26f9f2a0898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:04.592737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524f80-6c14-43b5-9a93-26f9f2a0898e admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.593052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524f80-6c14-43b5-9a93-26f9f2a0898e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.593320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524f80-6c14-43b5-9a93-26f9f2a0898e admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.593952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524f80-6c14-43b5-9a93-26f9f2a0898e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:04.595591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524f80-6c14-43b5-9a93-26f9f2a0898e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:04.605323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1196/2376] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:49:04.609285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0fe76-fc46-4ee4-8258-d6b9b22b13dd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:04.620165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0fe76-fc46-4ee4-8258-d6b9b22b13dd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:04.626394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3f07a-f873-4f95-8b39-b68b5728c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:04.627387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f07a-f873-4f95-8b39-b68b5728c8bf admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.627387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f07a-f873-4f95-8b39-b68b5728c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.627629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f07a-f873-4f95-8b39-b68b5728c8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.628291 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3f07a-f873-4f95-8b39-b68b5728c8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:04.629999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3f07a-f873-4f95-8b39-b68b5728c8bf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:04.640494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1181/2377] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:49:04.644497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524f80-6c14-43b5-9a93-26f9f2a0898e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:04.654675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524f80-6c14-43b5-9a93-26f9f2a0898e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:04.659505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:04.660138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.660412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.660679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] PATH_INFO: `/v3/projects/f101202542db41998eb3ce0a2d474b1c/users/5c1cc39e6f02482082a8b3171de3928f/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.675350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f101202542db41998eb3ce0a2d474b1c, user_id=5c1cc39e6f02482082a8b3171de3928f, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:04.678093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:04.766445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1197/2378] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:49:04 2022] PUT /identity/v3/projects/f101202542db41998eb3ce0a2d474b1c/users/5c1cc39e6f02482082a8b3171de3928f/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:49:04.776939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92dd0-54a1-4b12-8651-1841886fee4e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.777228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92dd0-54a1-4b12-8651-1841886fee4e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.777502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92dd0-54a1-4b12-8651-1841886fee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.805038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a1e92dd0-54a1-4b12-8651-1841886fee4e None None] MFA Rules not processed for user `5c1cc39e6f02482082a8b3171de3928f`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:49:04.806254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a1e92dd0-54a1-4b12-8651-1841886fee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:04.811220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:04.869162 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1182/2379] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:49:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:04.881533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:04.882754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:04.945194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57cbff-47e8-49bd-8130-fd84b5a64dae admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:04.950069 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d94686-f059-4971-89bf-f83e6663719a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb458a6186814aadb4ef178ff199582c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:04.950717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d94686-f059-4971-89bf-f83e6663719a service glance] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:04.951002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d94686-f059-4971-89bf-f83e6663719a service glance] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:04.951276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d94686-f059-4971-89bf-f83e6663719a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:04.960125 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d94686-f059-4971-89bf-f83e6663719a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:04.961728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d94686-f059-4971-89bf-f83e6663719a service glance] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:04.971504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1198/2380] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:49:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:49:14.900707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=24 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:14.966764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:53.699510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e92dd0-54a1-4b12-8651-1841886fee4e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:53.805240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e92dd0-54a1-4b12-8651-1841886fee4e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:53.809771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:53.810386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:53.817336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:53.817336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] PATH_INFO: `/v3/users/5c1cc39e6f02482082a8b3171de3928f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:53.817336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1cc39e6f02482082a8b3171de3928f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:53.817336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:53.976470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1cc39e6f02482082a8b3171de3928f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.024944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1cc39e6f02482082a8b3171de3928f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.032764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1cc39e6f02482082a8b3171de3928f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.044690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1cc39e6f02482082a8b3171de3928f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.045329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1cc39e6f02482082a8b3171de3928f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.053315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1183/2381] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:49:53 2022] DELETE /identity/v3/users/5c1cc39e6f02482082a8b3171de3928f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:49:54.057930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950893-2b1e-4dfa-9e5e-0adcb1f3e9b8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:54.058394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950893-2b1e-4dfa-9e5e-0adcb1f3e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:54.058536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950893-2b1e-4dfa-9e5e-0adcb1f3e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:54.105926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-cf950893-2b1e-4dfa-9e5e-0adcb1f3e9b8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:49:54.107145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cf950893-2b1e-4dfa-9e5e-0adcb1f3e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:54.164511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1199/2382] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:54.174916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:54.176324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:54.219450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:54.271450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7d97b-406f-4331-9975-b402705a5dce admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:54.275472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce49b2-fdc9-4102-86a0-f92624f8acbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:54.276227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce49b2-fdc9-4102-86a0-f92624f8acbf service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:54.276349 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce49b2-fdc9-4102-86a0-f92624f8acbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:54.276587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce49b2-fdc9-4102-86a0-f92624f8acbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:54.286381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce49b2-fdc9-4102-86a0-f92624f8acbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:54.287958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce49b2-fdc9-4102-86a0-f92624f8acbf service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:54.298337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1184/2383] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:49:54.714953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950893-2b1e-4dfa-9e5e-0adcb1f3e9b8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:54.716435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cf950893-2b1e-4dfa-9e5e-0adcb1f3e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:54.731914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950893-2b1e-4dfa-9e5e-0adcb1f3e9b8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:54.733627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:54.734346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:54.734732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:54.735063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] PATH_INFO: `/v3/projects/f101202542db41998eb3ce0a2d474b1c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:54.736490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f101202542db41998eb3ce0a2d474b1c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:54.738384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:54.845244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f101202542db41998eb3ce0a2d474b1c', 'request_id': 'req-b102f50a-d19f-428c-8185-2fc3ebdb2b08'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.850685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f101202542db41998eb3ce0a2d474b1c', 'request_id': 'req-b102f50a-d19f-428c-8185-2fc3ebdb2b08'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.856753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f101202542db41998eb3ce0a2d474b1c', 'request_id': 'req-b102f50a-d19f-428c-8185-2fc3ebdb2b08'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.948213 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] The token cache is being invalidate because project f101202542db41998eb3ce0a2d474b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:49:54.948501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.949127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b102f50a-d19f-428c-8185-2fc3ebdb2b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:49:54.950695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1200/2384] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:49:54 2022] DELETE /identity/v3/projects/f101202542db41998eb3ce0a2d474b1c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:49:54.955595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ff82-3d22-419c-817a-dd949eb8e3bc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:54.956020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ff82-3d22-419c-817a-dd949eb8e3bc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:54.956171 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ff82-3d22-419c-817a-dd949eb8e3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.005219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3183ff82-3d22-419c-817a-dd949eb8e3bc None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:49:55.006339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3183ff82-3d22-419c-817a-dd949eb8e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:55.065961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1185/2385] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:55.127917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41596c18-937c-43c9-8d0a-45ed3f46c0a7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.128488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41596c18-937c-43c9-8d0a-45ed3f46c0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.128488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41596c18-937c-43c9-8d0a-45ed3f46c0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.147664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-41596c18-937c-43c9-8d0a-45ed3f46c0a7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:49:55.149109 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-41596c18-937c-43c9-8d0a-45ed3f46c0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:55.157780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1201/2386] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:55.214340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ff82-3d22-419c-817a-dd949eb8e3bc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:55.224977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ff82-3d22-419c-817a-dd949eb8e3bc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:55.229529 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:55.230188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.230544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.230875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.231581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:49:55.231884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:55.233514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:55.245406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1186/2387] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:49:55.249845 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41596c18-937c-43c9-8d0a-45ed3f46c0a7 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:55.259463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41596c18-937c-43c9-8d0a-45ed3f46c0a7 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:55.263991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a394e-540d-4d55-a766-591696b04546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:55.264577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a394e-540d-4d55-a766-591696b04546 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.264853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a394e-540d-4d55-a766-591696b04546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.265146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a394e-540d-4d55-a766-591696b04546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.265761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a394e-540d-4d55-a766-591696b04546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:55.267684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a394e-540d-4d55-a766-591696b04546 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:55.394571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1202/2388] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:49:55 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:49:55.399075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:55.409931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36014c45-3164-4689-99af-2692b29f8677 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:55.469285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efba785-57d1-43f3-86cf-c961c6b83032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:55.469891 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba785-57d1-43f3-86cf-c961c6b83032 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.470166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba785-57d1-43f3-86cf-c961c6b83032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.470437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba785-57d1-43f3-86cf-c961c6b83032 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.471142 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efba785-57d1-43f3-86cf-c961c6b83032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:55.473056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efba785-57d1-43f3-86cf-c961c6b83032 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:55.616997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:55.623018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1187/2389] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:49:55 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:49:55.628681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a394e-540d-4d55-a766-591696b04546 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:55.637351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a394e-540d-4d55-a766-591696b04546 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:55.642505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b5bd-1367-4cd8-ac8b-982ed8697168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:55.643089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b5bd-1367-4cd8-ac8b-982ed8697168 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.643367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b5bd-1367-4cd8-ac8b-982ed8697168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.643637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b5bd-1367-4cd8-ac8b-982ed8697168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.644279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b5bd-1367-4cd8-ac8b-982ed8697168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:55.646029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b5bd-1367-4cd8-ac8b-982ed8697168 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:55.656964 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1203/2390] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:49:55.660971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efba785-57d1-43f3-86cf-c961c6b83032 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:55.671155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efba785-57d1-43f3-86cf-c961c6b83032 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:55.676257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914d863-bb01-4e3e-9adb-358e54c5c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:55.676645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d863-bb01-4e3e-9adb-358e54c5c5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.676922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d863-bb01-4e3e-9adb-358e54c5c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.677188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d863-bb01-4e3e-9adb-358e54c5c5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.677827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914d863-bb01-4e3e-9adb-358e54c5c5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:55.679454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914d863-bb01-4e3e-9adb-358e54c5c5ce admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:55.697534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1188/2391] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:49:55.700633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b5bd-1367-4cd8-ac8b-982ed8697168 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:55.711043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b5bd-1367-4cd8-ac8b-982ed8697168 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:55.715542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:55.716182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.716455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.716726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] PATH_INFO: `/v3/projects/067d95c57fb444af9c32ade5d5101f63/users/b2fcf396f7b14a0f9f253ff9ca34a2be/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.732502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] RBAC: Authorizing `identity:create_grant(project_id=067d95c57fb444af9c32ade5d5101f63, user_id=b2fcf396f7b14a0f9f253ff9ca34a2be, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:55.735185 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:55.737358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:55.802652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1204/2392] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:49:55 2022] PUT /identity/v3/projects/067d95c57fb444af9c32ade5d5101f63/users/b2fcf396f7b14a0f9f253ff9ca34a2be/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:49:55.817169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ad280-18cd-4a59-b696-fb127160c758 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.817169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ad280-18cd-4a59-b696-fb127160c758 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.817169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ad280-18cd-4a59-b696-fb127160c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.841286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b72ad280-18cd-4a59-b696-fb127160c758 None None] MFA Rules not processed for user `b2fcf396f7b14a0f9f253ff9ca34a2be`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:49:55.846684 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b72ad280-18cd-4a59-b696-fb127160c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:55.906707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1189/2393] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:49:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:49:55.918266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:49:55.920008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:49:55.978337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676fa20-b6b9-4edb-9f7b-16449614338f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:49:55.981972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c511148-16eb-481d-9f78-3ad84451ee81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:49:55.982695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c511148-16eb-481d-9f78-3ad84451ee81 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:49:55.982974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c511148-16eb-481d-9f78-3ad84451ee81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:49:55.983240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c511148-16eb-481d-9f78-3ad84451ee81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:49:55.991678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c511148-16eb-481d-9f78-3ad84451ee81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:49:55.993105 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c511148-16eb-481d-9f78-3ad84451ee81 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:49:56.002221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1205/2394] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:49:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:50:00.144292 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ad280-18cd-4a59-b696-fb127160c758 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:00.207893 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ad280-18cd-4a59-b696-fb127160c758 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:00.212448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:00.213074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:00.213348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:00.213616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] PATH_INFO: `/v3/users/b2fcf396f7b14a0f9f253ff9ca34a2be` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:00.214759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fcf396f7b14a0f9f253ff9ca34a2be)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:00.216656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:00.388691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fcf396f7b14a0f9f253ff9ca34a2be'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:00.455599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fcf396f7b14a0f9f253ff9ca34a2be'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:00.462459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fcf396f7b14a0f9f253ff9ca34a2be'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:00.473595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:00.474877 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fcf396f7b14a0f9f253ff9ca34a2be'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:00.475509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fcf396f7b14a0f9f253ff9ca34a2be'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:00.481259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1190/2395] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:50:00 2022] DELETE /identity/v3/users/b2fcf396f7b14a0f9f253ff9ca34a2be => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:50:00.485745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1979-4274-4201-9f20-3cae5f492eac None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:00.486219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1979-4274-4201-9f20-3cae5f492eac None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:00.489957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1979-4274-4201-9f20-3cae5f492eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:00.505364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-cbbd1979-4274-4201-9f20-3cae5f492eac None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:00.506598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cbbd1979-4274-4201-9f20-3cae5f492eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:00.563528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1206/2396] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:50:00.573066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:00.574480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:00.630534 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316a2e7-74cc-4899-aae9-f6570097bdc7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:00.634825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f7eba-81e3-4646-8ce1-a3df4437f4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:00.635420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7eba-81e3-4646-8ce1-a3df4437f4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:00.635696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7eba-81e3-4646-8ce1-a3df4437f4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:00.635964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7eba-81e3-4646-8ce1-a3df4437f4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:00.645837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f7eba-81e3-4646-8ce1-a3df4437f4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:00.647232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f7eba-81e3-4646-8ce1-a3df4437f4b7 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:00.657535 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1191/2397] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:50:01.091388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd1979-4274-4201-9f20-3cae5f492eac None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:01.092952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-cbbd1979-4274-4201-9f20-3cae5f492eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:01.105130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd1979-4274-4201-9f20-3cae5f492eac None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:01.110274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:01.110936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.111215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.111484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] PATH_INFO: `/v3/projects/067d95c57fb444af9c32ade5d5101f63` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.118104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067d95c57fb444af9c32ade5d5101f63)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:01.120038 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:01.221534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067d95c57fb444af9c32ade5d5101f63', 'request_id': 'req-cf327aef-9606-440c-956a-08a7e5bf3476'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:01.227049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067d95c57fb444af9c32ade5d5101f63', 'request_id': 'req-cf327aef-9606-440c-956a-08a7e5bf3476'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:01.233407 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067d95c57fb444af9c32ade5d5101f63', 'request_id': 'req-cf327aef-9606-440c-956a-08a7e5bf3476'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:01.293076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] The token cache is being invalidate because project 067d95c57fb444af9c32ade5d5101f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:50:01.293362 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:01.293992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cf327aef-9606-440c-956a-08a7e5bf3476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:50:01.296081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1207/2398] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:50:01 2022] DELETE /identity/v3/projects/067d95c57fb444af9c32ade5d5101f63 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:50:01.301276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198650c0-01bd-41d2-8888-cf0987f0ff68 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.301802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198650c0-01bd-41d2-8888-cf0987f0ff68 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.301802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198650c0-01bd-41d2-8888-cf0987f0ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.321001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-198650c0-01bd-41d2-8888-cf0987f0ff68 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:01.322193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-198650c0-01bd-41d2-8888-cf0987f0ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:01.384207 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1192/2399] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:01.392929 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bde92d-941b-44e3-90ff-b63e8d14c21d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.393212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bde92d-941b-44e3-90ff-b63e8d14c21d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.393484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bde92d-941b-44e3-90ff-b63e8d14c21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.414567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-22bde92d-941b-44e3-90ff-b63e8d14c21d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:01.415748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-22bde92d-941b-44e3-90ff-b63e8d14c21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:01.424184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1208/2400] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:01.428388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198650c0-01bd-41d2-8888-cf0987f0ff68 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:01.437962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198650c0-01bd-41d2-8888-cf0987f0ff68 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:01.442579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:01.443168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.443443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.443710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.444351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:50:01.444652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:01.446232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:01.457483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1193/2401] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:50:01.461862 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bde92d-941b-44e3-90ff-b63e8d14c21d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:01.471613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bde92d-941b-44e3-90ff-b63e8d14c21d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:01.476266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead544b-0480-42f5-b5d1-b2d1b1067ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:01.476866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead544b-0480-42f5-b5d1-b2d1b1067ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.477139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead544b-0480-42f5-b5d1-b2d1b1067ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.477525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead544b-0480-42f5-b5d1-b2d1b1067ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.478145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead544b-0480-42f5-b5d1-b2d1b1067ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:01.480067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead544b-0480-42f5-b5d1-b2d1b1067ebc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:01.492962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:01.626211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1209/2402] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:50:01 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:50:01.630683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:01.641418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce3549-e0dc-4a38-9efc-4e384559f9e5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:01.699851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c8f3e-b2ff-4d1e-8851-2c22084cd3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:01.700462 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c8f3e-b2ff-4d1e-8851-2c22084cd3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.700741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c8f3e-b2ff-4d1e-8851-2c22084cd3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.701013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c8f3e-b2ff-4d1e-8851-2c22084cd3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.701630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c8f3e-b2ff-4d1e-8851-2c22084cd3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:01.709685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c8f3e-b2ff-4d1e-8851-2c22084cd3a0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:01.805251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1194/2403] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:50:01 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:50:01.806492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead544b-0480-42f5-b5d1-b2d1b1067ebc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:01.816874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead544b-0480-42f5-b5d1-b2d1b1067ebc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:01.821499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30e04e-d70e-4e63-8a68-af634be35fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:01.824786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e04e-d70e-4e63-8a68-af634be35fde admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.824786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e04e-d70e-4e63-8a68-af634be35fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.824786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e04e-d70e-4e63-8a68-af634be35fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.824786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30e04e-d70e-4e63-8a68-af634be35fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:01.824786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30e04e-d70e-4e63-8a68-af634be35fde admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:01.835057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1210/2404] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:50:01.839048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c8f3e-b2ff-4d1e-8851-2c22084cd3a0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:01.849878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c8f3e-b2ff-4d1e-8851-2c22084cd3a0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:01.854522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1dca-ec6a-4f41-875e-f175c799b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:01.855111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1dca-ec6a-4f41-875e-f175c799b466 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.855391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1dca-ec6a-4f41-875e-f175c799b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.855663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1dca-ec6a-4f41-875e-f175c799b466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.856302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1dca-ec6a-4f41-875e-f175c799b466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:01.857965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1dca-ec6a-4f41-875e-f175c799b466 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:01.868388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1195/2405] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:50:01.872312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30e04e-d70e-4e63-8a68-af634be35fde admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:01.882022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30e04e-d70e-4e63-8a68-af634be35fde admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:01.886630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:01.887248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.887523 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.887791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] PATH_INFO: `/v3/projects/2788e89ec8a54cf0812124e6ce142061/users/1fefe615c29f4a8290c81ec430f8d9ae/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:01.904182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2788e89ec8a54cf0812124e6ce142061, user_id=1fefe615c29f4a8290c81ec430f8d9ae, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:01.907744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:01.993534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1211/2406] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:50:01 2022] PUT /identity/v3/projects/2788e89ec8a54cf0812124e6ce142061/users/1fefe615c29f4a8290c81ec430f8d9ae/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:50:01.998739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec055-a6e3-44be-ac17-51490b790015 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:01.999048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec055-a6e3-44be-ac17-51490b790015 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:01.999405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec055-a6e3-44be-ac17-51490b790015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:02.008192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:02.020087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-716ec055-a6e3-44be-ac17-51490b790015 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:02.021330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-716ec055-a6e3-44be-ac17-51490b790015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:02.078202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1196/2407] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:02.087808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:02.089472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:02.144661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7155c5-825f-45db-87e3-c5d32383692d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:02.144946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7155c5-825f-45db-87e3-c5d32383692d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:02.145213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7155c5-825f-45db-87e3-c5d32383692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:02.148090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c88dd-1e28-41c3-b46d-b41e2de4f5b5 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:02.152545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:02.153631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:02.153631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:02.153825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:02.162950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:02.164375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:02.174243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1212/2408] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:50:02.177092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bf7155c5-825f-45db-87e3-c5d32383692d None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:02.178312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf7155c5-825f-45db-87e3-c5d32383692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:02.241131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1197/2409] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:50:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:02.372169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:02.373657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:02.448776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555231d-3cf3-4678-a831-6bdc14ecdef5 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:02.454968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082388e-186d-41db-8551-e7e23dd170a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:02.455564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082388e-186d-41db-8551-e7e23dd170a7 service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:02.455837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082388e-186d-41db-8551-e7e23dd170a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:02.456107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082388e-186d-41db-8551-e7e23dd170a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:02.466267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082388e-186d-41db-8551-e7e23dd170a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:02.468544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082388e-186d-41db-8551-e7e23dd170a7 service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:02.478489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1213/2410] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:50:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:50:08.998802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f3d90-7721-4966-81f3-0eb41b87e0a1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:09.002185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f3d90-7721-4966-81f3-0eb41b87e0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:09.002185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f3d90-7721-4966-81f3-0eb41b87e0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:09.065907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dc1f3d90-7721-4966-81f3-0eb41b87e0a1 None None] MFA Rules not processed for user `1fefe615c29f4a8290c81ec430f8d9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:09.067184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dc1f3d90-7721-4966-81f3-0eb41b87e0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:09.171664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1198/2411] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:50:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:09.178054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082388e-186d-41db-8551-e7e23dd170a7 service swift] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:09.191374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082388e-186d-41db-8551-e7e23dd170a7 service swift] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:09.197318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693ce5-c26c-4e64-8b36-fe305b4f543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:09.198017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693ce5-c26c-4e64-8b36-fe305b4f543b admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:09.198365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693ce5-c26c-4e64-8b36-fe305b4f543b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:09.198899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693ce5-c26c-4e64-8b36-fe305b4f543b admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:09.199598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72693ce5-c26c-4e64-8b36-fe305b4f543b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:09.201917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72693ce5-c26c-4e64-8b36-fe305b4f543b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:09.292374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1214/2412] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:50:09 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:50:09.297266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f3d90-7721-4966-81f3-0eb41b87e0a1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:09.310584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f3d90-7721-4966-81f3-0eb41b87e0a1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:09.338240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:09.387186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454baa10-be40-4649-aa7a-398fb5600e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:09.387870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454baa10-be40-4649-aa7a-398fb5600e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:09.388075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454baa10-be40-4649-aa7a-398fb5600e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:09.388309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454baa10-be40-4649-aa7a-398fb5600e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:09.388932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454baa10-be40-4649-aa7a-398fb5600e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:09.391427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454baa10-be40-4649-aa7a-398fb5600e7a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:09.475704 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693ce5-c26c-4e64-8b36-fe305b4f543b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:09.481808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1199/2413] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:50:09 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:50:09.488457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693ce5-c26c-4e64-8b36-fe305b4f543b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:09.493576 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ca590-a4c4-4080-9b76-b95072f00416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:09.496728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ca590-a4c4-4080-9b76-b95072f00416 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:09.496728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ca590-a4c4-4080-9b76-b95072f00416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:09.496728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ca590-a4c4-4080-9b76-b95072f00416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:09.496728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ca590-a4c4-4080-9b76-b95072f00416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:09.497159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ca590-a4c4-4080-9b76-b95072f00416 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:09.510510 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1215/2414] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:50:09.513910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454baa10-be40-4649-aa7a-398fb5600e7a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:09.535197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454baa10-be40-4649-aa7a-398fb5600e7a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:09.540515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d0577-53fe-43d9-98ff-22614206455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:09.541260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0577-53fe-43d9-98ff-22614206455b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:09.541661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0577-53fe-43d9-98ff-22614206455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:09.542005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0577-53fe-43d9-98ff-22614206455b admin admin] PATH_INFO: `/v3/projects/be816ca2a5ee4354a7bc50141641b230/users/e5d12016c5db401a8c002bbed34fabc0/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:09.563324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d0577-53fe-43d9-98ff-22614206455b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be816ca2a5ee4354a7bc50141641b230, user_id=e5d12016c5db401a8c002bbed34fabc0, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:09.568254 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d0577-53fe-43d9-98ff-22614206455b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:09.685374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1200/2415] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:50:09 2022] PUT /identity/v3/projects/be816ca2a5ee4354a7bc50141641b230/users/e5d12016c5db401a8c002bbed34fabc0/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:50:09.690574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ca590-a4c4-4080-9b76-b95072f00416 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:09.705757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ca590-a4c4-4080-9b76-b95072f00416 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:09.735258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:09.810543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328762e4-c4f0-4acd-be14-f903136e8a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:09.810543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328762e4-c4f0-4acd-be14-f903136e8a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:09.810543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328762e4-c4f0-4acd-be14-f903136e8a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:09.810543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328762e4-c4f0-4acd-be14-f903136e8a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:09.811087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328762e4-c4f0-4acd-be14-f903136e8a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:09.812399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328762e4-c4f0-4acd-be14-f903136e8a03 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:09.828076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1216/2416] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:50:09.832185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d0577-53fe-43d9-98ff-22614206455b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:09.842914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d0577-53fe-43d9-98ff-22614206455b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:09.874738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:09.874738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:09.874738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:09.874738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] PATH_INFO: `/v3/projects/be816ca2a5ee4354a7bc50141641b230/users/e5d12016c5db401a8c002bbed34fabc0/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:09.875544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be816ca2a5ee4354a7bc50141641b230, user_id=e5d12016c5db401a8c002bbed34fabc0, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:09.875544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:09.875544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1201/2417] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:50:09 2022] PUT /identity/v3/projects/be816ca2a5ee4354a7bc50141641b230/users/e5d12016c5db401a8c002bbed34fabc0/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:50:17.388223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc53e4a-fa99-41dc-8805-acc822160078 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:17.389163 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc53e4a-fa99-41dc-8805-acc822160078 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:17.389656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc53e4a-fa99-41dc-8805-acc822160078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:17.428129 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7bc53e4a-fa99-41dc-8805-acc822160078 None None] MFA Rules not processed for user `e5d12016c5db401a8c002bbed34fabc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:17.430249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7bc53e4a-fa99-41dc-8805-acc822160078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:17.521252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1217/2418] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:50:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:17.538669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:17.540612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:17.647935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c79c9-cc15-44e2-b5b6-d25778ad343b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:17.655930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619551-06fc-477b-896a-013208f79cc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:17.656694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619551-06fc-477b-896a-013208f79cc1 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:17.656977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619551-06fc-477b-896a-013208f79cc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:17.657248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619551-06fc-477b-896a-013208f79cc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:17.719532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:17.725463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0619551-06fc-477b-896a-013208f79cc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:17.727502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0619551-06fc-477b-896a-013208f79cc1 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:17.738873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1202/2419] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:50:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:50:20.703155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3bfcf-43d6-4ca0-9daf-599fb445f044 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:20.703664 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3bfcf-43d6-4ca0-9daf-599fb445f044 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:20.703763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3bfcf-43d6-4ca0-9daf-599fb445f044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:20.723066 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-28a3bfcf-43d6-4ca0-9daf-599fb445f044 None None] MFA Rules not processed for user `1fefe615c29f4a8290c81ec430f8d9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:20.724278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-28a3bfcf-43d6-4ca0-9daf-599fb445f044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:20.737444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1218/2420] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:50:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:23.612682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ecb7f-b6e5-437b-8674-374dbefb9940 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:23.613569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ecb7f-b6e5-437b-8674-374dbefb9940 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:23.613846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ecb7f-b6e5-437b-8674-374dbefb9940 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:23.615246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1203/2421] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:50:23.620952 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d388-4c1c-4975-be8b-338283c6f65f None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:23.621406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d388-4c1c-4975-be8b-338283c6f65f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:23.621505 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d388-4c1c-4975-be8b-338283c6f65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:23.644471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-35e8d388-4c1c-4975-be8b-338283c6f65f None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:23.645670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-35e8d388-4c1c-4975-be8b-338283c6f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:23.664238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1219/2422] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:50:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:23.678649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ecb7f-b6e5-437b-8674-374dbefb9940 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:23.680955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c17ecb7f-b6e5-437b-8674-374dbefb9940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:23.747053 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ecb7f-b6e5-437b-8674-374dbefb9940 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:23.750808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d88a3-59c7-4d04-8cb9-f8be2d512c27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb458a6186814aadb4ef178ff199582c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:23.754122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d88a3-59c7-4d04-8cb9-f8be2d512c27 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:23.754122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d88a3-59c7-4d04-8cb9-f8be2d512c27 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:23.754122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d88a3-59c7-4d04-8cb9-f8be2d512c27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:23.763118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d88a3-59c7-4d04-8cb9-f8be2d512c27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:23.764549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d88a3-59c7-4d04-8cb9-f8be2d512c27 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:23.777276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1204/2423] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:50:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:50:24.038846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b20439-3321-441d-ac9b-3add4b5802e8 None None] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:24.039128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b20439-3321-441d-ac9b-3add4b5802e8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:24.039405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b20439-3321-441d-ac9b-3add4b5802e8 None None] PATH_INFO: `/` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:24.040730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1220/2424] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:50:24.045598 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b970ac-3011-4be4-adb7-5b4284e6080f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:24.045894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b970ac-3011-4be4-adb7-5b4284e6080f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:24.046179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b970ac-3011-4be4-adb7-5b4284e6080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:24.066701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-03b970ac-3011-4be4-adb7-5b4284e6080f None None] MFA Rules not processed for user `80c8c0985f6847368c4f7263b2bf8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:24.067996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03b970ac-3011-4be4-adb7-5b4284e6080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:24.118276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1205/2425] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:50:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:24.130515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b20439-3321-441d-ac9b-3add4b5802e8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:24.132249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-57b20439-3321-441d-ac9b-3add4b5802e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:24.145978 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b20439-3321-441d-ac9b-3add4b5802e8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:24.150344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956a79b-85c6-4aea-aabc-d071b761f009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:24.151264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a79b-85c6-4aea-aabc-d071b761f009 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:24.151762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a79b-85c6-4aea-aabc-d071b761f009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:24.152243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956a79b-85c6-4aea-aabc-d071b761f009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:24.160142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956a79b-85c6-4aea-aabc-d071b761f009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:24.161600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956a79b-85c6-4aea-aabc-d071b761f009 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:24.169737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1221/2426] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:50:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:50:24.262629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5201e4-875d-4cfb-8b95-ae71d3372e9e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:24.262629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5201e4-875d-4cfb-8b95-ae71d3372e9e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:24.262629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5201e4-875d-4cfb-8b95-ae71d3372e9e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:24.262629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1206/2427] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 10 08:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 08:50:24.264915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4c56-cac9-48f2-ac95-7464d66d3cbb None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:24.265793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4c56-cac9-48f2-ac95-7464d66d3cbb None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:24.266062 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4c56-cac9-48f2-ac95-7464d66d3cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:24.285432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-232d4c56-cac9-48f2-ac95-7464d66d3cbb None None] MFA Rules not processed for user `74d6165eeb524d18aa963f3dcaf84dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:24.286628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-232d4c56-cac9-48f2-ac95-7464d66d3cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:24.295919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1222/2428] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 10 08:50:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:24.306285 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5201e4-875d-4cfb-8b95-ae71d3372e9e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:24.317656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5201e4-875d-4cfb-8b95-ae71d3372e9e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:24.321356 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a20d4-2c9d-4b55-b67d-aa6cc57d0b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:24.321943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a20d4-2c9d-4b55-b67d-aa6cc57d0b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:24.322220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a20d4-2c9d-4b55-b67d-aa6cc57d0b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:24.322517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a20d4-2c9d-4b55-b67d-aa6cc57d0b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:24.333336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a20d4-2c9d-4b55-b67d-aa6cc57d0b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:24.334886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a20d4-2c9d-4b55-b67d-aa6cc57d0b98 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:24.346160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1207/2429] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:50:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:50:26.886782 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a26f74-7ff6-4a53-a330-f5dd85fcd3a2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:26.887308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a26f74-7ff6-4a53-a330-f5dd85fcd3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:26.887308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a26f74-7ff6-4a53-a330-f5dd85fcd3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:26.907151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-46a26f74-7ff6-4a53-a330-f5dd85fcd3a2 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:26.908331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-46a26f74-7ff6-4a53-a330-f5dd85fcd3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:26.967332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1223/2430] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:50:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:50:26.985183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a20d4-2c9d-4b55-b67d-aa6cc57d0b98 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:27.049906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a20d4-2c9d-4b55-b67d-aa6cc57d0b98 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:27.054997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97024cf5-bd73-4a3d-a1a9-59e9a3bdb19f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:27.055615 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97024cf5-bd73-4a3d-a1a9-59e9a3bdb19f service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:27.055866 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97024cf5-bd73-4a3d-a1a9-59e9a3bdb19f service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:27.056143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97024cf5-bd73-4a3d-a1a9-59e9a3bdb19f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:27.064986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97024cf5-bd73-4a3d-a1a9-59e9a3bdb19f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:27.066591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97024cf5-bd73-4a3d-a1a9-59e9a3bdb19f service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:27.075082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1208/2431] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:50:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:50:36.958199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=96 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:37.071907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:51.357337 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a26f74-7ff6-4a53-a330-f5dd85fcd3a2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:51.358987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-46a26f74-7ff6-4a53-a330-f5dd85fcd3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:51.382369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf96e-dd87-445a-a802-d1aa1b972788 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:51.382898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf96e-dd87-445a-a802-d1aa1b972788 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:51.382985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf96e-dd87-445a-a802-d1aa1b972788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:51.402743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-382bf96e-dd87-445a-a802-d1aa1b972788 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:51.403953 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-382bf96e-dd87-445a-a802-d1aa1b972788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:51.413963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1209/2432] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 10 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:50:51.414934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bf96e-dd87-445a-a802-d1aa1b972788 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:51.416165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-382bf96e-dd87-445a-a802-d1aa1b972788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:51.459255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a26f74-7ff6-4a53-a330-f5dd85fcd3a2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:51.464796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:51.465523 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:51.465806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:51.466087 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:51.467854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:51.481561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:51.483184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:51.492569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bf96e-dd87-445a-a802-d1aa1b972788 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:51.496805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1224/2433] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:50:51.496805 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:50:51.497751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f536a-77d3-4247-91f4-984b514533a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:51.498360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f536a-77d3-4247-91f4-984b514533a4 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:51.498687 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f536a-77d3-4247-91f4-984b514533a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:51.498940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f536a-77d3-4247-91f4-984b514533a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:51.505496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea247c-fe5a-4fba-a7b2-80fd67390aa9 service placement] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:50:51.508709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f536a-77d3-4247-91f4-984b514533a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:51.510371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f536a-77d3-4247-91f4-984b514533a4 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:51.511879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57436953-c243-4c38-9ba3-e60529edcd0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:50:51.512581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57436953-c243-4c38-9ba3-e60529edcd0a service swift] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:51.512744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57436953-c243-4c38-9ba3-e60529edcd0a service swift] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:51.513141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57436953-c243-4c38-9ba3-e60529edcd0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:51.522008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1210/2434] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:50:51.522286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57436953-c243-4c38-9ba3-e60529edcd0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:50:51.523894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57436953-c243-4c38-9ba3-e60529edcd0a service swift] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:50:51.532159 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1225/2435] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:50:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:50:57.724458 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569e88-860c-40d5-a1f9-f5dd4afc885a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:50:57.724898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569e88-860c-40d5-a1f9-f5dd4afc885a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:50:57.725136 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569e88-860c-40d5-a1f9-f5dd4afc885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:50:57.743862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b4569e88-860c-40d5-a1f9-f5dd4afc885a None None] MFA Rules not processed for user `4542138b7aa5446b8544dc766cbcb372`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:50:57.745051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b4569e88-860c-40d5-a1f9-f5dd4afc885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:50:57.801544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1211/2436] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:50:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:01.528890 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=47 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:07.792829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=60 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:16.878322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57436953-c243-4c38-9ba3-e60529edcd0a service swift] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:16.889308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57436953-c243-4c38-9ba3-e60529edcd0a service swift] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:16.893132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:16.894034 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:16.894410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:16.894809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:16.905106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:16.906909 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:16.919108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1226/2437] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:21.902242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4569e88-860c-40d5-a1f9-f5dd4afc885a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:21.911969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4569e88-860c-40d5-a1f9-f5dd4afc885a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:21.915546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:21.916146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:21.916419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:21.916688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:21.918389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:21.981003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:21.982430 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:21.992538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1212/2438] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:22.632427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:22.633822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:22.715880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a7b45-0065-421d-a3e1-b67f6207f595 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:22.719641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:22.720291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:22.720582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:22.720837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:22.723220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:22.784748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:22.786195 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:22.795423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1227/2439] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:25.305567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:25.307216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:25.320472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8e5f8-e67a-4a69-9e0f-870225bd2e97 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:25.325182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:25.325813 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:25.326093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:25.326366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] PATH_INFO: `/v3/users/661a67fbdd6941889c706d2560c920a2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:25.327553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661a67fbdd6941889c706d2560c920a2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:25.329485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:25.483351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661a67fbdd6941889c706d2560c920a2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:25.577494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661a67fbdd6941889c706d2560c920a2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:25.585287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661a67fbdd6941889c706d2560c920a2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:25.597859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661a67fbdd6941889c706d2560c920a2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:25.598507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-570ae057-f631-479b-bf0f-03e96868b2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661a67fbdd6941889c706d2560c920a2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:25.604516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1213/2440] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:51:25 2022] DELETE /identity/v3/users/661a67fbdd6941889c706d2560c920a2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:25.860453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:25.878406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07f3e9-3efc-42fc-898e-fc4140a1c6a1 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:25.937002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:25.937636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:25.937919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:25.938196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] PATH_INFO: `/v3/projects/fd42ddf1ccf54e1598b65a08b08774b7` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:25.949288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd42ddf1ccf54e1598b65a08b08774b7)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:25.951291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:25.968666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:26.075509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd42ddf1ccf54e1598b65a08b08774b7', 'request_id': 'req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:26.080796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd42ddf1ccf54e1598b65a08b08774b7', 'request_id': 'req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:26.087906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd42ddf1ccf54e1598b65a08b08774b7', 'request_id': 'req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:26.160800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] The token cache is being invalidate because project fd42ddf1ccf54e1598b65a08b08774b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:26.161081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:26.161717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-24dacc23-b2e9-4a0f-9de4-d52c4b738fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:26.163262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1228/2441] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:25 2022] DELETE /identity/v3/projects/fd42ddf1ccf54e1598b65a08b08774b7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:26.168441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d362f-a539-4434-aa6b-d8020db6a2c3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.168441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d362f-a539-4434-aa6b-d8020db6a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.168715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d362f-a539-4434-aa6b-d8020db6a2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.187543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-975d362f-a539-4434-aa6b-d8020db6a2c3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:26.188765 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-975d362f-a539-4434-aa6b-d8020db6a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:26.245903 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1214/2442] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:26.254423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db8cb4-cc7a-4f1e-ad3e-10e20afedfc8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.254740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db8cb4-cc7a-4f1e-ad3e-10e20afedfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.255016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db8cb4-cc7a-4f1e-ad3e-10e20afedfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.274324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-16db8cb4-cc7a-4f1e-ad3e-10e20afedfc8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:26.275557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-16db8cb4-cc7a-4f1e-ad3e-10e20afedfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:26.283752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1229/2443] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:26.287681 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d362f-a539-4434-aa6b-d8020db6a2c3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:26.297808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d362f-a539-4434-aa6b-d8020db6a2c3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:26.303302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:26.303967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.304330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.304706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.305358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:51:26.305655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:26.307279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:26.308820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:26.319993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1215/2444] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:51:26.326245 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db8cb4-cc7a-4f1e-ad3e-10e20afedfc8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:26.335762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db8cb4-cc7a-4f1e-ad3e-10e20afedfc8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:26.340675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00573e-4a26-4c97-ab8e-d97840594c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:26.341272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00573e-4a26-4c97-ab8e-d97840594c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.341548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00573e-4a26-4c97-ab8e-d97840594c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.341817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00573e-4a26-4c97-ab8e-d97840594c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.342433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00573e-4a26-4c97-ab8e-d97840594c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:26.344416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00573e-4a26-4c97-ab8e-d97840594c7c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:26.465710 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1230/2445] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:26 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:26.470031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:26.481890 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fee54-a417-42cd-a912-d088bf96c79a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:26.537909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca413-9a01-41ed-8f2c-97cd24539f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:26.538528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca413-9a01-41ed-8f2c-97cd24539f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.548874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca413-9a01-41ed-8f2c-97cd24539f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.548874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca413-9a01-41ed-8f2c-97cd24539f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.548874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca413-9a01-41ed-8f2c-97cd24539f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:26.548874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca413-9a01-41ed-8f2c-97cd24539f40 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:26.641445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1216/2446] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:51:26 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:26.645962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00573e-4a26-4c97-ab8e-d97840594c7c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:26.656497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00573e-4a26-4c97-ab8e-d97840594c7c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:26.661632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cc1d2-b345-4eea-af9e-c2caeb81e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:26.662259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cc1d2-b345-4eea-af9e-c2caeb81e8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.662571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cc1d2-b345-4eea-af9e-c2caeb81e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.662842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cc1d2-b345-4eea-af9e-c2caeb81e8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.663477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cc1d2-b345-4eea-af9e-c2caeb81e8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:26.665072 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cc1d2-b345-4eea-af9e-c2caeb81e8fd admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:26.675024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1231/2447] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:26.679686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca413-9a01-41ed-8f2c-97cd24539f40 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:26.689884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca413-9a01-41ed-8f2c-97cd24539f40 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:26.694577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e131ce-e53f-4747-8ae0-b64dfd5a15c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:26.695286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e131ce-e53f-4747-8ae0-b64dfd5a15c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.695565 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e131ce-e53f-4747-8ae0-b64dfd5a15c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.695831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e131ce-e53f-4747-8ae0-b64dfd5a15c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.696459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e131ce-e53f-4747-8ae0-b64dfd5a15c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:26.698036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e131ce-e53f-4747-8ae0-b64dfd5a15c1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:26.708430 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1217/2448] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:26.712641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cc1d2-b345-4eea-af9e-c2caeb81e8fd admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:26.722757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cc1d2-b345-4eea-af9e-c2caeb81e8fd admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:26.727941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d2062-b400-40d0-9fe2-a68418475db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:26.728571 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2062-b400-40d0-9fe2-a68418475db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.728847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2062-b400-40d0-9fe2-a68418475db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.729115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2062-b400-40d0-9fe2-a68418475db9 admin admin] PATH_INFO: `/v3/projects/b1879ebbe6774746ab69658fd5a8a50b/users/d111f6217122497fb746d34a73a4caa1/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.743853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d2062-b400-40d0-9fe2-a68418475db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1879ebbe6774746ab69658fd5a8a50b, user_id=d111f6217122497fb746d34a73a4caa1, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:26.746492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d2062-b400-40d0-9fe2-a68418475db9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:26.840436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1232/2449] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:26 2022] PUT /identity/v3/projects/b1879ebbe6774746ab69658fd5a8a50b/users/d111f6217122497fb746d34a73a4caa1/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:26.852258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daacfed-4f8f-4730-9cc8-3f64be4a3b1e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:26.852544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daacfed-4f8f-4730-9cc8-3f64be4a3b1e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:26.852826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daacfed-4f8f-4730-9cc8-3f64be4a3b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:26.880461 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3daacfed-4f8f-4730-9cc8-3f64be4a3b1e None None] MFA Rules not processed for user `d111f6217122497fb746d34a73a4caa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:26.881679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3daacfed-4f8f-4730-9cc8-3f64be4a3b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:26.945159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1218/2450] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:26.949292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d2062-b400-40d0-9fe2-a68418475db9 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:27.009327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d2062-b400-40d0-9fe2-a68418475db9 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:27.013956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23e7f-d17c-470a-8d80-6a75f67cc0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:27.014569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23e7f-d17c-470a-8d80-6a75f67cc0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.014847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23e7f-d17c-470a-8d80-6a75f67cc0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.015112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23e7f-d17c-470a-8d80-6a75f67cc0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:27.015714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23e7f-d17c-470a-8d80-6a75f67cc0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:27.017598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23e7f-d17c-470a-8d80-6a75f67cc0f7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:27.104850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1233/2451] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:26 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:27.109066 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daacfed-4f8f-4730-9cc8-3f64be4a3b1e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:27.119874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daacfed-4f8f-4730-9cc8-3f64be4a3b1e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:27.175102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50fd51-9de3-491d-a432-7e39206523ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:27.175679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50fd51-9de3-491d-a432-7e39206523ab admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.175989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50fd51-9de3-491d-a432-7e39206523ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.176268 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50fd51-9de3-491d-a432-7e39206523ab admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:27.176871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50fd51-9de3-491d-a432-7e39206523ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:27.178807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50fd51-9de3-491d-a432-7e39206523ab admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:27.187239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:27.298821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1219/2452] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:51:27 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:27.302926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23e7f-d17c-470a-8d80-6a75f67cc0f7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:27.313563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23e7f-d17c-470a-8d80-6a75f67cc0f7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:27.319027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27516f8-3de3-4da3-a525-57d73e015f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:27.319623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27516f8-3de3-4da3-a525-57d73e015f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.319933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27516f8-3de3-4da3-a525-57d73e015f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.320198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27516f8-3de3-4da3-a525-57d73e015f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:27.320841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27516f8-3de3-4da3-a525-57d73e015f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:27.322414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27516f8-3de3-4da3-a525-57d73e015f63 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:27.334370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1234/2453] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:51:27.338440 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50fd51-9de3-491d-a432-7e39206523ab admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:27.348706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50fd51-9de3-491d-a432-7e39206523ab admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:27.353345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686d15-978a-448d-8fbd-02867a682442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:27.353986 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686d15-978a-448d-8fbd-02867a682442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.354267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686d15-978a-448d-8fbd-02867a682442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.354577 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686d15-978a-448d-8fbd-02867a682442 admin admin] PATH_INFO: `/v3/projects/28c1744e944348c78019011ee534b37f/users/8bc9cacad5894877bc74585a4df9264e/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:27.368875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57686d15-978a-448d-8fbd-02867a682442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c1744e944348c78019011ee534b37f, user_id=8bc9cacad5894877bc74585a4df9264e, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:27.371579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57686d15-978a-448d-8fbd-02867a682442 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:27.447217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1220/2454] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:27 2022] PUT /identity/v3/projects/28c1744e944348c78019011ee534b37f/users/8bc9cacad5894877bc74585a4df9264e/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:27.451156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27516f8-3de3-4da3-a525-57d73e015f63 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:27.458002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:27.461861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27516f8-3de3-4da3-a525-57d73e015f63 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:27.517256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2fbc-cbf9-4c06-8f36-4a43c5338164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:27.517855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2fbc-cbf9-4c06-8f36-4a43c5338164 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.518134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2fbc-cbf9-4c06-8f36-4a43c5338164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.518421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2fbc-cbf9-4c06-8f36-4a43c5338164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:27.519089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2fbc-cbf9-4c06-8f36-4a43c5338164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:27.521625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2fbc-cbf9-4c06-8f36-4a43c5338164 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:27.531057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1235/2455] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:27.535336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686d15-978a-448d-8fbd-02867a682442 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:27.546148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686d15-978a-448d-8fbd-02867a682442 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:27.550928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:27.552074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.552354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.552631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] PATH_INFO: `/v3/projects/28c1744e944348c78019011ee534b37f/users/8bc9cacad5894877bc74585a4df9264e/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:27.554638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c1744e944348c78019011ee534b37f, user_id=8bc9cacad5894877bc74585a4df9264e, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:27.557276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:27.567966 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1221/2456] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:27 2022] PUT /identity/v3/projects/28c1744e944348c78019011ee534b37f/users/8bc9cacad5894877bc74585a4df9264e/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:27.578342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23cf3-3fd2-4cb8-90d0-54e66c5dfbc1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.578662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23cf3-3fd2-4cb8-90d0-54e66c5dfbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.579082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23cf3-3fd2-4cb8-90d0-54e66c5dfbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:27.608098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-2be23cf3-3fd2-4cb8-90d0-54e66c5dfbc1 None None] MFA Rules not processed for user `8bc9cacad5894877bc74585a4df9264e`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:27.609293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2be23cf3-3fd2-4cb8-90d0-54e66c5dfbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:27.676687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1236/2457] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:27.687925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:27.689717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:27.748527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d192b-310a-4d80-9f9a-fd1b7f359533 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:27.752236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c06da-08aa-496d-b8bc-38982dd86c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:27.752832 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c06da-08aa-496d-b8bc-38982dd86c02 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.753110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c06da-08aa-496d-b8bc-38982dd86c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.753381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c06da-08aa-496d-b8bc-38982dd86c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:27.762245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c06da-08aa-496d-b8bc-38982dd86c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:27.764439 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c06da-08aa-496d-b8bc-38982dd86c02 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:27.773827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1222/2458] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:27.935712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be23cf3-3fd2-4cb8-90d0-54e66c5dfbc1 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:27.945451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be23cf3-3fd2-4cb8-90d0-54e66c5dfbc1 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:27.949043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54963792-c176-493e-bde0-741fc8c112ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:27.949667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963792-c176-493e-bde0-741fc8c112ac service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:27.950190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963792-c176-493e-bde0-741fc8c112ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:27.950190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963792-c176-493e-bde0-741fc8c112ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:28.005289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54963792-c176-493e-bde0-741fc8c112ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:28.006731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54963792-c176-493e-bde0-741fc8c112ac service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:28.015396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1237/2459] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:31.374911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c06da-08aa-496d-b8bc-38982dd86c02 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:31.437322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c06da-08aa-496d-b8bc-38982dd86c02 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:31.442391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:31.443079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:31.443360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:31.443627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] PATH_INFO: `/v3/users/d111f6217122497fb746d34a73a4caa1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:31.444769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d111f6217122497fb746d34a73a4caa1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:31.446749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:31.665602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd111f6217122497fb746d34a73a4caa1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:31.732730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd111f6217122497fb746d34a73a4caa1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:31.737456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:31.740622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd111f6217122497fb746d34a73a4caa1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:31.752469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd111f6217122497fb746d34a73a4caa1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:31.753130 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd111f6217122497fb746d34a73a4caa1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:31.759625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1223/2460] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:51:31 2022] DELETE /identity/v3/users/d111f6217122497fb746d34a73a4caa1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:31.764063 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13f5a-a1f7-4732-9592-13e10d6fcd94 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:31.764522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13f5a-a1f7-4732-9592-13e10d6fcd94 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:31.764659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13f5a-a1f7-4732-9592-13e10d6fcd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:31.783903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-62f13f5a-a1f7-4732-9592-13e10d6fcd94 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:31.785157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-62f13f5a-a1f7-4732-9592-13e10d6fcd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:31.804653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:31.845266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1238/2461] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:31.855500 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:31.856922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:31.912572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6af85-fb83-4efc-9b30-90998f9d2da9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:31.916222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012f936-aac7-4f03-a114-213126770f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:31.916774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012f936-aac7-4f03-a114-213126770f3b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:31.917051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012f936-aac7-4f03-a114-213126770f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:31.917328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012f936-aac7-4f03-a114-213126770f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:31.927226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012f936-aac7-4f03-a114-213126770f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:31.928671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012f936-aac7-4f03-a114-213126770f3b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:31.938488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1224/2462] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:51:32.317474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13f5a-a1f7-4732-9592-13e10d6fcd94 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:32.319021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-62f13f5a-a1f7-4732-9592-13e10d6fcd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:32.331104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13f5a-a1f7-4732-9592-13e10d6fcd94 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:32.336351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:32.337107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:32.337240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:32.337511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] PATH_INFO: `/v3/projects/b1879ebbe6774746ab69658fd5a8a50b` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:32.343685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1879ebbe6774746ab69658fd5a8a50b)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:32.343685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:32.440703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1879ebbe6774746ab69658fd5a8a50b', 'request_id': 'req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.446033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1879ebbe6774746ab69658fd5a8a50b', 'request_id': 'req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.452078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1879ebbe6774746ab69658fd5a8a50b', 'request_id': 'req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.531778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] The token cache is being invalidate because project b1879ebbe6774746ab69658fd5a8a50b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:32.532060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.532748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.534248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1239/2463] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:32 2022] DELETE /identity/v3/projects/b1879ebbe6774746ab69658fd5a8a50b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:32.538846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012f936-aac7-4f03-a114-213126770f3b service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:32.548224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012f936-aac7-4f03-a114-213126770f3b service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:32.603708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:32.604335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:32.604612 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:32.604882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] PATH_INFO: `/v3/users/8bc9cacad5894877bc74585a4df9264e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:32.605999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc9cacad5894877bc74585a4df9264e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:32.607956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:32.781132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc9cacad5894877bc74585a4df9264e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.869126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc9cacad5894877bc74585a4df9264e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.876326 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc9cacad5894877bc74585a4df9264e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.888548 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc9cacad5894877bc74585a4df9264e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.889216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-baaef181-a036-4c56-9231-7ed3562bb7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc9cacad5894877bc74585a4df9264e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:32.890614 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:32.896519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1225/2464] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:51:32 2022] DELETE /identity/v3/users/8bc9cacad5894877bc74585a4df9264e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:33.322883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:33.324370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:33.337291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df0af0-f93d-401d-8312-1b7fd47b2e6f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:33.394651 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:33.395535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:33.395815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:33.396088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] PATH_INFO: `/v3/projects/28c1744e944348c78019011ee534b37f` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:33.397214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c1744e944348c78019011ee534b37f)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:33.399176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:33.515564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c1744e944348c78019011ee534b37f', 'request_id': 'req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:33.516779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:33.522002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c1744e944348c78019011ee534b37f', 'request_id': 'req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:33.528003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c1744e944348c78019011ee534b37f', 'request_id': 'req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:33.629405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] The token cache is being invalidate because project 28c1744e944348c78019011ee534b37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:33.629676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:33.630340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8b6c4c45-8cb0-4681-b5a7-30a9b505051c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:33.631905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1240/2465] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:33 2022] DELETE /identity/v3/projects/28c1744e944348c78019011ee534b37f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:33.637040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b717c-21b1-4d0f-8f4a-73434170521f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:33.637536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b717c-21b1-4d0f-8f4a-73434170521f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:33.637680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b717c-21b1-4d0f-8f4a-73434170521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:33.657635 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-263b717c-21b1-4d0f-8f4a-73434170521f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:33.660715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-263b717c-21b1-4d0f-8f4a-73434170521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:33.718412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1226/2466] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:33.728193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa3b0-30c4-4d70-8c13-c368daff16cb None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:33.728474 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa3b0-30c4-4d70-8c13-c368daff16cb None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:33.728746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa3b0-30c4-4d70-8c13-c368daff16cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:33.748293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-79faa3b0-30c4-4d70-8c13-c368daff16cb None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:33.749495 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-79faa3b0-30c4-4d70-8c13-c368daff16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:33.757320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1241/2467] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:33.761641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b717c-21b1-4d0f-8f4a-73434170521f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:33.772369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b717c-21b1-4d0f-8f4a-73434170521f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:33.777280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:33.777945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:33.778232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:33.778522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:33.779182 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:51:33.779509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:33.781259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:33.793818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1227/2468] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:51:33.798250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faa3b0-30c4-4d70-8c13-c368daff16cb None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:33.807637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faa3b0-30c4-4d70-8c13-c368daff16cb None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:33.812545 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf77e1-1d29-4c99-b9cc-4700f9b8bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:33.813128 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf77e1-1d29-4c99-b9cc-4700f9b8bc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:33.813438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf77e1-1d29-4c99-b9cc-4700f9b8bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:33.813708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf77e1-1d29-4c99-b9cc-4700f9b8bc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:33.814324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf77e1-1d29-4c99-b9cc-4700f9b8bc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:33.816238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf77e1-1d29-4c99-b9cc-4700f9b8bc28 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:33.928973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1242/2469] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:33 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:33.932716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:33.942842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679e914-a134-4e87-aa15-7008a86cb138 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:33.998741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb07f50-a21b-4510-b1d0-4d06efad36e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:33.999452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07f50-a21b-4510-b1d0-4d06efad36e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:33.999730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07f50-a21b-4510-b1d0-4d06efad36e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.000002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb07f50-a21b-4510-b1d0-4d06efad36e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.000618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb07f50-a21b-4510-b1d0-4d06efad36e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.002552 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb07f50-a21b-4510-b1d0-4d06efad36e8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.087413 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1228/2470] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:51:33 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:34.092303 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf77e1-1d29-4c99-b9cc-4700f9b8bc28 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.102769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf77e1-1d29-4c99-b9cc-4700f9b8bc28 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.107265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b32f4-b82f-4c6e-ae17-fbac0eb5e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.107851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b32f4-b82f-4c6e-ae17-fbac0eb5e251 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.108125 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b32f4-b82f-4c6e-ae17-fbac0eb5e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.108390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b32f4-b82f-4c6e-ae17-fbac0eb5e251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.109126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b32f4-b82f-4c6e-ae17-fbac0eb5e251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.110733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b32f4-b82f-4c6e-ae17-fbac0eb5e251 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.120574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1243/2471] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:34.124456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb07f50-a21b-4510-b1d0-4d06efad36e8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.134960 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb07f50-a21b-4510-b1d0-4d06efad36e8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.139989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b83269-7540-41d6-9dbc-74170bb28a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.140609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b83269-7540-41d6-9dbc-74170bb28a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.140894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b83269-7540-41d6-9dbc-74170bb28a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.141183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b83269-7540-41d6-9dbc-74170bb28a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.141830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b83269-7540-41d6-9dbc-74170bb28a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.143604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b83269-7540-41d6-9dbc-74170bb28a47 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.155283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1229/2472] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:34.159386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b32f4-b82f-4c6e-ae17-fbac0eb5e251 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.169198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b32f4-b82f-4c6e-ae17-fbac0eb5e251 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.173880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51001319-c6da-4ec6-9041-6344c19ad927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.174536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51001319-c6da-4ec6-9041-6344c19ad927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.174814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51001319-c6da-4ec6-9041-6344c19ad927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.175080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51001319-c6da-4ec6-9041-6344c19ad927 admin admin] PATH_INFO: `/v3/projects/25986840409f497281e156c005c41285/users/304b075fcc0141499b64768e4638dd96/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.189042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51001319-c6da-4ec6-9041-6344c19ad927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25986840409f497281e156c005c41285, user_id=304b075fcc0141499b64768e4638dd96, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.192220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51001319-c6da-4ec6-9041-6344c19ad927 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.264662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1244/2473] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:34 2022] PUT /identity/v3/projects/25986840409f497281e156c005c41285/users/304b075fcc0141499b64768e4638dd96/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:34.276558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bba71-ded4-4dcc-be81-86b7f5e31334 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.276558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bba71-ded4-4dcc-be81-86b7f5e31334 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.276558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bba71-ded4-4dcc-be81-86b7f5e31334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.304337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e80bba71-ded4-4dcc-be81-86b7f5e31334 None None] MFA Rules not processed for user `304b075fcc0141499b64768e4638dd96`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:34.305661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e80bba71-ded4-4dcc-be81-86b7f5e31334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:34.321446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dada439-1be4-4c4b-9a1e-3b554658a565 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.321757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dada439-1be4-4c4b-9a1e-3b554658a565 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.322054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dada439-1be4-4c4b-9a1e-3b554658a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.341608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1dada439-1be4-4c4b-9a1e-3b554658a565 None None] MFA Rules not processed for user `f1c7a90e90e5411f92eddd180ef9e27d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:34.342930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1dada439-1be4-4c4b-9a1e-3b554658a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:34.361429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:34.372376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1230/2474] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:34.377669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bba71-ded4-4dcc-be81-86b7f5e31334 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.402745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1245/2475] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:51:34.443729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dada439-1be4-4c4b-9a1e-3b554658a565 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.444860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bba71-ded4-4dcc-be81-86b7f5e31334 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.444996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1dada439-1be4-4c4b-9a1e-3b554658a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:34.449666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37895186-537b-4adc-b522-ae787fe93e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.450370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895186-537b-4adc-b522-ae787fe93e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.450686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895186-537b-4adc-b522-ae787fe93e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.450955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895186-537b-4adc-b522-ae787fe93e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.451573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37895186-537b-4adc-b522-ae787fe93e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.453492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37895186-537b-4adc-b522-ae787fe93e9d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.500306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dada439-1be4-4c4b-9a1e-3b554658a565 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.504622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.505217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.505493 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.505761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.507550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:34.541734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:34.565602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1231/2476] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:34 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:34.567252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37895186-537b-4adc-b522-ae787fe93e9d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.581287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.582748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.593920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1246/2477] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:51:34.633889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37895186-537b-4adc-b522-ae787fe93e9d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.639135 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d856c9-104d-4210-abce-ac60b0c70cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.639730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d856c9-104d-4210-abce-ac60b0c70cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.639730 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d856c9-104d-4210-abce-ac60b0c70cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.639901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d856c9-104d-4210-abce-ac60b0c70cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.640463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d856c9-104d-4210-abce-ac60b0c70cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.642567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d856c9-104d-4210-abce-ac60b0c70cb0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.713341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1232/2478] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:51:34 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:51:34.714542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.737367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e085da-eba2-428f-a443-cfb57ff716b6 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.743342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6cb1c-f54a-4eba-aeef-9add8c2f0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.743966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6cb1c-f54a-4eba-aeef-9add8c2f0995 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.745218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6cb1c-f54a-4eba-aeef-9add8c2f0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.745218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6cb1c-f54a-4eba-aeef-9add8c2f0995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.745218 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6cb1c-f54a-4eba-aeef-9add8c2f0995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.746853 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6cb1c-f54a-4eba-aeef-9add8c2f0995 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.757950 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1247/2479] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:34.762276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d856c9-104d-4210-abce-ac60b0c70cb0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.775661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d856c9-104d-4210-abce-ac60b0c70cb0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.780676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd0e1c-3309-4b2f-aa2d-b6778bc1da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.781392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0e1c-3309-4b2f-aa2d-b6778bc1da19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.781675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0e1c-3309-4b2f-aa2d-b6778bc1da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.781946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0e1c-3309-4b2f-aa2d-b6778bc1da19 admin admin] PATH_INFO: `/v3/projects/586b8c4471414c3bbeee76e0cfbfc5c4/users/220b53d6a61945aa96d27320e0f35518/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.798936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd0e1c-3309-4b2f-aa2d-b6778bc1da19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586b8c4471414c3bbeee76e0cfbfc5c4, user_id=220b53d6a61945aa96d27320e0f35518, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.802124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd0e1c-3309-4b2f-aa2d-b6778bc1da19 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.887895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1233/2480] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:34 2022] PUT /identity/v3/projects/586b8c4471414c3bbeee76e0cfbfc5c4/users/220b53d6a61945aa96d27320e0f35518/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:34.891803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6cb1c-f54a-4eba-aeef-9add8c2f0995 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:34.902478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6cb1c-f54a-4eba-aeef-9add8c2f0995 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:34.964212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854bd54-62e1-4b88-af92-a2d0872968bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:34.964748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bd54-62e1-4b88-af92-a2d0872968bf admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:34.965020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bd54-62e1-4b88-af92-a2d0872968bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:34.965289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bd54-62e1-4b88-af92-a2d0872968bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:34.965931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854bd54-62e1-4b88-af92-a2d0872968bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:34.967604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854bd54-62e1-4b88-af92-a2d0872968bf admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:34.981542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1248/2481] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:34.991704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd0e1c-3309-4b2f-aa2d-b6778bc1da19 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:35.002683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd0e1c-3309-4b2f-aa2d-b6778bc1da19 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:35.007713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0a2c-cb57-4ab8-a463-4b392713c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:35.008366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0a2c-cb57-4ab8-a463-4b392713c730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:35.008639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0a2c-cb57-4ab8-a463-4b392713c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:35.008909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0a2c-cb57-4ab8-a463-4b392713c730 admin admin] PATH_INFO: `/v3/projects/586b8c4471414c3bbeee76e0cfbfc5c4/users/220b53d6a61945aa96d27320e0f35518/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:35.010929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e0a2c-cb57-4ab8-a463-4b392713c730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586b8c4471414c3bbeee76e0cfbfc5c4, user_id=220b53d6a61945aa96d27320e0f35518, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:35.013770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e0a2c-cb57-4ab8-a463-4b392713c730 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:35.025006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1234/2482] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:34 2022] PUT /identity/v3/projects/586b8c4471414c3bbeee76e0cfbfc5c4/users/220b53d6a61945aa96d27320e0f35518/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:35.036078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470415b-9d3d-48e7-bdce-78415981a9ec None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:35.036385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470415b-9d3d-48e7-bdce-78415981a9ec None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:35.036657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470415b-9d3d-48e7-bdce-78415981a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:35.066127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f470415b-9d3d-48e7-bdce-78415981a9ec None None] MFA Rules not processed for user `220b53d6a61945aa96d27320e0f35518`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:35.067416 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f470415b-9d3d-48e7-bdce-78415981a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:35.137451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1249/2483] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:35.150198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0a2c-cb57-4ab8-a463-4b392713c730 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:35.189597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:35.212562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0a2c-cb57-4ab8-a463-4b392713c730 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:35.216403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea39cc-92b5-4590-bdfd-81a9b8464ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:35.216945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea39cc-92b5-4590-bdfd-81a9b8464ced service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:35.217266 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea39cc-92b5-4590-bdfd-81a9b8464ced service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:35.217536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea39cc-92b5-4590-bdfd-81a9b8464ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:35.227322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea39cc-92b5-4590-bdfd-81a9b8464ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:35.228808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea39cc-92b5-4590-bdfd-81a9b8464ced service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:35.238448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1235/2484] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:35.614227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470415b-9d3d-48e7-bdce-78415981a9ec None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:35.616024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f470415b-9d3d-48e7-bdce-78415981a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:35.651417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:35.674995 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470415b-9d3d-48e7-bdce-78415981a9ec None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:35.678753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:35.679380 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:35.679652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:35.680094 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:35.681707 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:35.762193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:35.763668 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:35.775578 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1250/2485] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:36.081071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea39cc-92b5-4590-bdfd-81a9b8464ced service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:36.090700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea39cc-92b5-4590-bdfd-81a9b8464ced service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:36.095798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '220b53d6a61945aa96d27320e0f35518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586b8c4471414c3bbeee76e0cfbfc5c4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:36.096489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:36.096823 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:36.097166 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:36.097819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:51:36.098123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:36.099783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:36.111259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1236/2486] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:51:36.116042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:36.126228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fa4d5-c761-4a0f-a450-2454a2496b72 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:36.131281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0a26-1f60-4136-b1e4-b8ebed1b50f3 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '220b53d6a61945aa96d27320e0f35518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586b8c4471414c3bbeee76e0cfbfc5c4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:36.131869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0a26-1f60-4136-b1e4-b8ebed1b50f3 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:36.132148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0a26-1f60-4136-b1e4-b8ebed1b50f3 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:36.132417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0a26-1f60-4136-b1e4-b8ebed1b50f3 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:36.133035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f0a26-1f60-4136-b1e4-b8ebed1b50f3 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:36.134937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f0a26-1f60-4136-b1e4-b8ebed1b50f3 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:36.243153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1251/2487] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:36 2022] POST /identity/v3/projects => generated 354 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:51:36.247275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:36.257691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6c11-a182-48a5-b026-c2b7e4807167 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:36.312943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '220b53d6a61945aa96d27320e0f35518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586b8c4471414c3bbeee76e0cfbfc5c4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:36.313546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:36.313827 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:36.314100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:36.314779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:51:36.315084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:36.317297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:36.329132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1237/2488] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:51:36.365746 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0a26-1f60-4136-b1e4-b8ebed1b50f3 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:36.376947 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0a26-1f60-4136-b1e4-b8ebed1b50f3 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:36.381536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '220b53d6a61945aa96d27320e0f35518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586b8c4471414c3bbeee76e0cfbfc5c4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:36.382150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:36.382433 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:36.382731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] PATH_INFO: `/v3/projects/27691f13ae654e45946c77b475a113c9` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:36.383830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27691f13ae654e45946c77b475a113c9)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:36.385715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:36.463644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27691f13ae654e45946c77b475a113c9', 'request_id': 'req-0eee23e3-98d1-414f-a844-7e80f522e470'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:36.469189 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27691f13ae654e45946c77b475a113c9', 'request_id': 'req-0eee23e3-98d1-414f-a844-7e80f522e470'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:36.476363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27691f13ae654e45946c77b475a113c9', 'request_id': 'req-0eee23e3-98d1-414f-a844-7e80f522e470'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:36.560344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] The token cache is being invalidate because project 27691f13ae654e45946c77b475a113c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:36.560715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:36.561425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-0eee23e3-98d1-414f-a844-7e80f522e470 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:36.562962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1252/2489] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:36 2022] DELETE /identity/v3/projects/27691f13ae654e45946c77b475a113c9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:37.101080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:37.102826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:37.165745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fde4a0-5abc-487a-8a2e-0832026ace41 tempest-VolumeQuotaClassesTest-1415706412 tempest-VolumeQuotaClassesTest-1415706412-project-admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:37.220256 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:37.220807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:37.221080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:37.221348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] PATH_INFO: `/v3/users/304b075fcc0141499b64768e4638dd96` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:37.222487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304b075fcc0141499b64768e4638dd96)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:37.224389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:37.226591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:37.386100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304b075fcc0141499b64768e4638dd96'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:37.435198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304b075fcc0141499b64768e4638dd96'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:37.443601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304b075fcc0141499b64768e4638dd96'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:37.456192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304b075fcc0141499b64768e4638dd96'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:37.459238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304b075fcc0141499b64768e4638dd96'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:37.463392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1238/2490] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:51:37 2022] DELETE /identity/v3/users/304b075fcc0141499b64768e4638dd96 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:37.468007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb13f-ed0e-4762-ab67-c56fc8d62540 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:37.468481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb13f-ed0e-4762-ab67-c56fc8d62540 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:37.468685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb13f-ed0e-4762-ab67-c56fc8d62540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:37.488349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-720bb13f-ed0e-4762-ab67-c56fc8d62540 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:37.490091 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-720bb13f-ed0e-4762-ab67-c56fc8d62540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:37.524284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:37.555232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1253/2491] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:37.564950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:37.566583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:37.631722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab503592-9998-4915-bb59-61bc1ae25cb8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:37.635507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372abac-6904-4df3-8dd5-d671f5835faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:37.636113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372abac-6904-4df3-8dd5-d671f5835faf service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:37.636392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372abac-6904-4df3-8dd5-d671f5835faf service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:37.636665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372abac-6904-4df3-8dd5-d671f5835faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:37.646353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372abac-6904-4df3-8dd5-d671f5835faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:37.647912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372abac-6904-4df3-8dd5-d671f5835faf service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:37.658000 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1239/2492] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:38.341567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb13f-ed0e-4762-ab67-c56fc8d62540 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:38.343436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-720bb13f-ed0e-4762-ab67-c56fc8d62540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:38.358308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb13f-ed0e-4762-ab67-c56fc8d62540 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:38.363956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:38.364944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:38.365388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:38.365916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] PATH_INFO: `/v3/projects/25986840409f497281e156c005c41285` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:38.367301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25986840409f497281e156c005c41285)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:38.377276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:38.517494 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25986840409f497281e156c005c41285', 'request_id': 'req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.524669 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25986840409f497281e156c005c41285', 'request_id': 'req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.531873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25986840409f497281e156c005c41285', 'request_id': 'req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.641412 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] The token cache is being invalidate because project 25986840409f497281e156c005c41285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:38.641702 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.642343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.643884 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1254/2493] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:38 2022] DELETE /identity/v3/projects/25986840409f497281e156c005c41285 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:38.648718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372abac-6904-4df3-8dd5-d671f5835faf service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:38.658531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372abac-6904-4df3-8dd5-d671f5835faf service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:38.716747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:38.717421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:38.717696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:38.717965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] PATH_INFO: `/v3/users/220b53d6a61945aa96d27320e0f35518` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:38.719148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=220b53d6a61945aa96d27320e0f35518)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:38.721159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:38.790622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:38.868258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220b53d6a61945aa96d27320e0f35518'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.916030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220b53d6a61945aa96d27320e0f35518'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.925263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220b53d6a61945aa96d27320e0f35518'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.947315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220b53d6a61945aa96d27320e0f35518'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.948016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4a0a136e-7237-47c8-9c0e-277f9fd610cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220b53d6a61945aa96d27320e0f35518'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:38.954396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1240/2494] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:51:38 2022] DELETE /identity/v3/users/220b53d6a61945aa96d27320e0f35518 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:39.546665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:39.548224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:39.561271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd5c47-76f3-48cc-9e6e-96888b57f1c9 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:39.632004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:39.632644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:39.632925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:39.633199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] PATH_INFO: `/v3/projects/586b8c4471414c3bbeee76e0cfbfc5c4` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:39.634333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586b8c4471414c3bbeee76e0cfbfc5c4)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:39.636298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:39.780058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586b8c4471414c3bbeee76e0cfbfc5c4', 'request_id': 'req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:39.787174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586b8c4471414c3bbeee76e0cfbfc5c4', 'request_id': 'req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:39.788780 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:39.797015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586b8c4471414c3bbeee76e0cfbfc5c4', 'request_id': 'req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:39.881698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] The token cache is being invalidate because project 586b8c4471414c3bbeee76e0cfbfc5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:39.882140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:39.882840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-4dbd3e57-50d3-4cc4-b283-702b6b6c9927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:39.884358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1255/2495] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:39 2022] DELETE /identity/v3/projects/586b8c4471414c3bbeee76e0cfbfc5c4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:39.889275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb835e-1e49-4ca8-8c7c-54db6859b3bf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:39.889788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb835e-1e49-4ca8-8c7c-54db6859b3bf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:39.889788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb835e-1e49-4ca8-8c7c-54db6859b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:39.910537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f1cb835e-1e49-4ca8-8c7c-54db6859b3bf None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:39.911741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f1cb835e-1e49-4ca8-8c7c-54db6859b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:39.973282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1241/2496] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:39.982264 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6c9e-1169-4961-a280-9932c14d2a96 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:39.982613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6c9e-1169-4961-a280-9932c14d2a96 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:39.982959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6c9e-1169-4961-a280-9932c14d2a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.005492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4a8e6c9e-1169-4961-a280-9932c14d2a96 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:40.005492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4a8e6c9e-1169-4961-a280-9932c14d2a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:40.013378 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1256/2497] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:40.017669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb835e-1e49-4ca8-8c7c-54db6859b3bf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.027950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb835e-1e49-4ca8-8c7c-54db6859b3bf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.032606 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.034335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.034335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.034335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.034335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:51:40.034908 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.036723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.049026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1242/2498] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:51:40.054061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e6c9e-1169-4961-a280-9932c14d2a96 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.063216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e6c9e-1169-4961-a280-9932c14d2a96 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.067859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c290b10-d13d-4445-abe2-73f2fafe4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.068533 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c290b10-d13d-4445-abe2-73f2fafe4a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.068815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c290b10-d13d-4445-abe2-73f2fafe4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.069089 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c290b10-d13d-4445-abe2-73f2fafe4a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.069700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c290b10-d13d-4445-abe2-73f2fafe4a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.071625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c290b10-d13d-4445-abe2-73f2fafe4a83 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.146286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1257/2499] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:40 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:40.150629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.160515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c79e6-5cf8-4268-92ec-b1202e31ed48 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.217870 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a730-801c-4993-8cc1-90964f434d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.218488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a730-801c-4993-8cc1-90964f434d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.218791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a730-801c-4993-8cc1-90964f434d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.219058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a730-801c-4993-8cc1-90964f434d14 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.219683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a730-801c-4993-8cc1-90964f434d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.221619 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a730-801c-4993-8cc1-90964f434d14 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.320681 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c290b10-d13d-4445-abe2-73f2fafe4a83 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.328641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1243/2500] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:51:40 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:40.332607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c290b10-d13d-4445-abe2-73f2fafe4a83 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.337485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca745-f9bc-4d7d-8754-9a471dc9124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.338150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca745-f9bc-4d7d-8754-9a471dc9124d admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.338435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca745-f9bc-4d7d-8754-9a471dc9124d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.338743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca745-f9bc-4d7d-8754-9a471dc9124d admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.339394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fca745-f9bc-4d7d-8754-9a471dc9124d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.341272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fca745-f9bc-4d7d-8754-9a471dc9124d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.353289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1258/2501] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:40.357594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a730-801c-4993-8cc1-90964f434d14 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.369663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a730-801c-4993-8cc1-90964f434d14 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.375086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a37d9-f110-4f19-80f1-fb08b431dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.375699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a37d9-f110-4f19-80f1-fb08b431dd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.375980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a37d9-f110-4f19-80f1-fb08b431dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.376241 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a37d9-f110-4f19-80f1-fb08b431dd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.377051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a37d9-f110-4f19-80f1-fb08b431dd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.378682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a37d9-f110-4f19-80f1-fb08b431dd54 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.390513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1244/2502] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:40.394459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca745-f9bc-4d7d-8754-9a471dc9124d admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.407804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca745-f9bc-4d7d-8754-9a471dc9124d admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.412993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c272f-375d-43ff-b9d9-7cfdbe73e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.413676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c272f-375d-43ff-b9d9-7cfdbe73e4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.413961 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c272f-375d-43ff-b9d9-7cfdbe73e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.414232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c272f-375d-43ff-b9d9-7cfdbe73e4e7 admin admin] PATH_INFO: `/v3/projects/43f1415a0c4542c8a9708359855d93d4/users/56184d585f774406855c3fe82244df8d/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.431523 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c272f-375d-43ff-b9d9-7cfdbe73e4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f1415a0c4542c8a9708359855d93d4, user_id=56184d585f774406855c3fe82244df8d, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.434366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c272f-375d-43ff-b9d9-7cfdbe73e4e7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.492931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1259/2503] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:40 2022] PUT /identity/v3/projects/43f1415a0c4542c8a9708359855d93d4/users/56184d585f774406855c3fe82244df8d/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:40.503501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad865750-efd0-401b-9bd6-a24ccc8284d8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.503788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad865750-efd0-401b-9bd6-a24ccc8284d8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.504059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad865750-efd0-401b-9bd6-a24ccc8284d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.524318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:40.533038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ad865750-efd0-401b-9bd6-a24ccc8284d8 None None] MFA Rules not processed for user `56184d585f774406855c3fe82244df8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:40.534271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ad865750-efd0-401b-9bd6-a24ccc8284d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:40.599902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1245/2504] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:40.605911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c272f-375d-43ff-b9d9-7cfdbe73e4e7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.668999 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c272f-375d-43ff-b9d9-7cfdbe73e4e7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.673699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8097c-c0b9-42ab-8628-8d1a85060e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.674272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8097c-c0b9-42ab-8628-8d1a85060e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.674579 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8097c-c0b9-42ab-8628-8d1a85060e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.674851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8097c-c0b9-42ab-8628-8d1a85060e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.675467 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8097c-c0b9-42ab-8628-8d1a85060e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.677390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8097c-c0b9-42ab-8628-8d1a85060e61 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.791991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1260/2505] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:40 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:40.795884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad865750-efd0-401b-9bd6-a24ccc8284d8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.806586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad865750-efd0-401b-9bd6-a24ccc8284d8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.860896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b93de6-e715-4b3e-a8d4-120cd59cd52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.861444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93de6-e715-4b3e-a8d4-120cd59cd52d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.861720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93de6-e715-4b3e-a8d4-120cd59cd52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.861987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93de6-e715-4b3e-a8d4-120cd59cd52d admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.862624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b93de6-e715-4b3e-a8d4-120cd59cd52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.864526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b93de6-e715-4b3e-a8d4-120cd59cd52d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.936846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1246/2506] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:51:40 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:40.940759 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8097c-c0b9-42ab-8628-8d1a85060e61 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.952789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8097c-c0b9-42ab-8628-8d1a85060e61 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.958455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d9c31-bf82-431e-865b-df14d0e605c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.959131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d9c31-bf82-431e-865b-df14d0e605c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.959466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d9c31-bf82-431e-865b-df14d0e605c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.959747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d9c31-bf82-431e-865b-df14d0e605c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:40.960396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d9c31-bf82-431e-865b-df14d0e605c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:40.961996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d9c31-bf82-431e-865b-df14d0e605c4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:40.972596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1261/2507] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:51:40.976774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b93de6-e715-4b3e-a8d4-120cd59cd52d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:40.986790 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b93de6-e715-4b3e-a8d4-120cd59cd52d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:40.991399 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c703-5c47-4c8f-a6d1-fd7adaf7fc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:40.992035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c703-5c47-4c8f-a6d1-fd7adaf7fc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:40.992312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c703-5c47-4c8f-a6d1-fd7adaf7fc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:40.992583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0c703-5c47-4c8f-a6d1-fd7adaf7fc4b admin admin] PATH_INFO: `/v3/projects/ed8b2f1fdfcf4b7db8ee95ad9478ecac/users/ef6aa9ddc4b24206a7af98186c44ef3e/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:41.007754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0c703-5c47-4c8f-a6d1-fd7adaf7fc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b2f1fdfcf4b7db8ee95ad9478ecac, user_id=ef6aa9ddc4b24206a7af98186c44ef3e, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:41.010400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0c703-5c47-4c8f-a6d1-fd7adaf7fc4b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:41.087158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1247/2508] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:40 2022] PUT /identity/v3/projects/ed8b2f1fdfcf4b7db8ee95ad9478ecac/users/ef6aa9ddc4b24206a7af98186c44ef3e/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:41.091007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d9c31-bf82-431e-865b-df14d0e605c4 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:41.101073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d9c31-bf82-431e-865b-df14d0e605c4 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:41.150779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:41.156472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2fc21-7ace-481b-875f-4d7208ac363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:41.157064 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fc21-7ace-481b-875f-4d7208ac363f admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:41.157345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fc21-7ace-481b-875f-4d7208ac363f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:41.157618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fc21-7ace-481b-875f-4d7208ac363f admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:41.158254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2fc21-7ace-481b-875f-4d7208ac363f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:41.159913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2fc21-7ace-481b-875f-4d7208ac363f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:41.169482 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1262/2509] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:41.173744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c703-5c47-4c8f-a6d1-fd7adaf7fc4b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:41.184589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0c703-5c47-4c8f-a6d1-fd7adaf7fc4b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:41.189270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:41.193295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:41.193295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:41.193295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] PATH_INFO: `/v3/projects/ed8b2f1fdfcf4b7db8ee95ad9478ecac/users/ef6aa9ddc4b24206a7af98186c44ef3e/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:41.193295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b2f1fdfcf4b7db8ee95ad9478ecac, user_id=ef6aa9ddc4b24206a7af98186c44ef3e, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:41.195867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:41.205981 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1248/2510] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:41 2022] PUT /identity/v3/projects/ed8b2f1fdfcf4b7db8ee95ad9478ecac/users/ef6aa9ddc4b24206a7af98186c44ef3e/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:51:41.216919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59d5d-ccc3-4e00-a423-fde1fc849655 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:41.222028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59d5d-ccc3-4e00-a423-fde1fc849655 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:41.222028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59d5d-ccc3-4e00-a423-fde1fc849655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:41.245156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-13f59d5d-ccc3-4e00-a423-fde1fc849655 None None] MFA Rules not processed for user `ef6aa9ddc4b24206a7af98186c44ef3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:41.246366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-13f59d5d-ccc3-4e00-a423-fde1fc849655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:41.312434 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1263/2511] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:51:41.324340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:41.326006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:41.383131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333f57-0822-4d5b-9b34-cd689b600e25 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:41.386804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36a16d-acad-4d44-8710-8fb137bf5643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:41.387396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36a16d-acad-4d44-8710-8fb137bf5643 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:41.387675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36a16d-acad-4d44-8710-8fb137bf5643 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:41.387947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36a16d-acad-4d44-8710-8fb137bf5643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:41.393923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:41.397700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36a16d-acad-4d44-8710-8fb137bf5643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:41.399164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36a16d-acad-4d44-8710-8fb137bf5643 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:41.408585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1249/2512] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:41.566741 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59d5d-ccc3-4e00-a423-fde1fc849655 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:41.576666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59d5d-ccc3-4e00-a423-fde1fc849655 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:41.580607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd43f8a-fc11-43c5-b84d-1898e33496d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:41.581273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd43f8a-fc11-43c5-b84d-1898e33496d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:41.581554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd43f8a-fc11-43c5-b84d-1898e33496d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:41.581828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd43f8a-fc11-43c5-b84d-1898e33496d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:41.641082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd43f8a-fc11-43c5-b84d-1898e33496d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:41.642575 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd43f8a-fc11-43c5-b84d-1898e33496d6 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:41.651861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1264/2513] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:42.123383 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36a16d-acad-4d44-8710-8fb137bf5643 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:42.184131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36a16d-acad-4d44-8710-8fb137bf5643 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:42.188629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:42.189247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:42.189519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:42.189785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] PATH_INFO: `/v3/users/56184d585f774406855c3fe82244df8d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:42.190908 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56184d585f774406855c3fe82244df8d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:42.192810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:42.305737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56184d585f774406855c3fe82244df8d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:42.360729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56184d585f774406855c3fe82244df8d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:42.367904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56184d585f774406855c3fe82244df8d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:42.380064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56184d585f774406855c3fe82244df8d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:42.380698 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56184d585f774406855c3fe82244df8d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:42.386547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1250/2514] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:51:42 2022] DELETE /identity/v3/users/56184d585f774406855c3fe82244df8d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:42.390976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e590d-c728-4461-a723-ac06b58f70dd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:42.391263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e590d-c728-4461-a723-ac06b58f70dd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:42.391538 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e590d-c728-4461-a723-ac06b58f70dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:42.410870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1c6e590d-c728-4461-a723-ac06b58f70dd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:42.412075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1c6e590d-c728-4461-a723-ac06b58f70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:42.469785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1265/2515] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:42.479394 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:42.480786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:42.537689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9a2d-77c1-4b95-9b7f-0ea0f93f0c08 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:42.541450 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b31e7-2f7a-4030-b6ed-ebe1aeb46771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:42.542049 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b31e7-2f7a-4030-b6ed-ebe1aeb46771 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:42.542768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b31e7-2f7a-4030-b6ed-ebe1aeb46771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:42.542768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b31e7-2f7a-4030-b6ed-ebe1aeb46771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:42.552013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b31e7-2f7a-4030-b6ed-ebe1aeb46771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:42.553446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b31e7-2f7a-4030-b6ed-ebe1aeb46771 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:42.563222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1251/2516] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:42.962687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e590d-c728-4461-a723-ac06b58f70dd None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:42.964257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1c6e590d-c728-4461-a723-ac06b58f70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:42.976283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e590d-c728-4461-a723-ac06b58f70dd None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:42.980908 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:42.981548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:42.981822 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:42.982095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] PATH_INFO: `/v3/projects/43f1415a0c4542c8a9708359855d93d4` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:42.983252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f1415a0c4542c8a9708359855d93d4)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:42.985172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:42.997590 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:43.091446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f1415a0c4542c8a9708359855d93d4', 'request_id': 'req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.096810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f1415a0c4542c8a9708359855d93d4', 'request_id': 'req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.103287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f1415a0c4542c8a9708359855d93d4', 'request_id': 'req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.199406 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] The token cache is being invalidate because project 43f1415a0c4542c8a9708359855d93d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:43.199692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.200283 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.201838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1266/2517] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:42 2022] DELETE /identity/v3/projects/43f1415a0c4542c8a9708359855d93d4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:43.205856 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b31e7-2f7a-4030-b6ed-ebe1aeb46771 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:43.215474 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b31e7-2f7a-4030-b6ed-ebe1aeb46771 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:43.227010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:43.270863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:43.271487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:43.271771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:43.272043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] PATH_INFO: `/v3/users/ef6aa9ddc4b24206a7af98186c44ef3e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:43.273170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6aa9ddc4b24206a7af98186c44ef3e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:43.275159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:43.397400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6aa9ddc4b24206a7af98186c44ef3e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.440460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6aa9ddc4b24206a7af98186c44ef3e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.447409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6aa9ddc4b24206a7af98186c44ef3e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.459689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6aa9ddc4b24206a7af98186c44ef3e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.460319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-776ee864-bbd8-4d36-9a26-7f4b20f1f234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6aa9ddc4b24206a7af98186c44ef3e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:43.466079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1252/2518] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:51:43 2022] DELETE /identity/v3/users/ef6aa9ddc4b24206a7af98186c44ef3e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:43.859849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:43.861574 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:43.882982 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f6451-c8f0-48d0-a7ff-64af658fbabe admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:43.948967 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:43.950119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:43.950119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:43.950345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] PATH_INFO: `/v3/projects/ed8b2f1fdfcf4b7db8ee95ad9478ecac` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:43.951509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8b2f1fdfcf4b7db8ee95ad9478ecac)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:43.953421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:44.052602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8b2f1fdfcf4b7db8ee95ad9478ecac', 'request_id': 'req-a42db44f-e1c6-4053-a508-cf928547e640'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:44.058267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8b2f1fdfcf4b7db8ee95ad9478ecac', 'request_id': 'req-a42db44f-e1c6-4053-a508-cf928547e640'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:44.064331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8b2f1fdfcf4b7db8ee95ad9478ecac', 'request_id': 'req-a42db44f-e1c6-4053-a508-cf928547e640'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:44.107973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] The token cache is being invalidate because project ed8b2f1fdfcf4b7db8ee95ad9478ecac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:44.108252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:44.108864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a42db44f-e1c6-4053-a508-cf928547e640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:44.110335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1267/2519] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:43 2022] DELETE /identity/v3/projects/ed8b2f1fdfcf4b7db8ee95ad9478ecac => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:44.115219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b68f73-56f2-4192-b971-c6db712356ef None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.115905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b68f73-56f2-4192-b971-c6db712356ef None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.116034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b68f73-56f2-4192-b971-c6db712356ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.135716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f5b68f73-56f2-4192-b971-c6db712356ef None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:44.136984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f5b68f73-56f2-4192-b971-c6db712356ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:44.195831 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1253/2520] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:44.203471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d166f-3c21-4092-a375-5c14eea72f61 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.203754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d166f-3c21-4092-a375-5c14eea72f61 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.204025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d166f-3c21-4092-a375-5c14eea72f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.223187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-964d166f-3c21-4092-a375-5c14eea72f61 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:44.224381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-964d166f-3c21-4092-a375-5c14eea72f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:44.234312 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1268/2521] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:51:44.238164 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b68f73-56f2-4192-b971-c6db712356ef None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:44.249191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b68f73-56f2-4192-b971-c6db712356ef None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:44.255414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:44.256064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.256368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.256638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.257296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:51:44.257599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:44.259262 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:44.273171 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1254/2522] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:51:44.279785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d166f-3c21-4092-a375-5c14eea72f61 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:44.289327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d166f-3c21-4092-a375-5c14eea72f61 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:44.294052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee680d-d523-475e-8c70-b32a441e20f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:44.294687 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee680d-d523-475e-8c70-b32a441e20f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.294966 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee680d-d523-475e-8c70-b32a441e20f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.295232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee680d-d523-475e-8c70-b32a441e20f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.295863 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee680d-d523-475e-8c70-b32a441e20f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:44.297763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee680d-d523-475e-8c70-b32a441e20f2 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:44.395828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1269/2523] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:44 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:44.396979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:44.407360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88189b-4dee-4ac7-b396-3e548d894b23 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:44.427374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:44.466710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150da6e-8577-4e45-97a4-f63da26a4ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:44.467239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150da6e-8577-4e45-97a4-f63da26a4ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.467512 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150da6e-8577-4e45-97a4-f63da26a4ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.467798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150da6e-8577-4e45-97a4-f63da26a4ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.468464 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150da6e-8577-4e45-97a4-f63da26a4ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:44.470419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150da6e-8577-4e45-97a4-f63da26a4ce2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:44.650360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1255/2524] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:51:44 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:44.651661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee680d-d523-475e-8c70-b32a441e20f2 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:44.657454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:44.663713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee680d-d523-475e-8c70-b32a441e20f2 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:44.668447 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecf69b-b4f5-4e10-8ff1-cbe4685228f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:44.669061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecf69b-b4f5-4e10-8ff1-cbe4685228f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.669342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecf69b-b4f5-4e10-8ff1-cbe4685228f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.669616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecf69b-b4f5-4e10-8ff1-cbe4685228f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.670266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecf69b-b4f5-4e10-8ff1-cbe4685228f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:44.671910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecf69b-b4f5-4e10-8ff1-cbe4685228f9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:44.682756 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1270/2525] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:44.686859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150da6e-8577-4e45-97a4-f63da26a4ce2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:44.697126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150da6e-8577-4e45-97a4-f63da26a4ce2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:44.701783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54227754-66d1-4e40-a5d8-fd3a1a8003d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:44.702378 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227754-66d1-4e40-a5d8-fd3a1a8003d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.702683 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227754-66d1-4e40-a5d8-fd3a1a8003d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.703508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227754-66d1-4e40-a5d8-fd3a1a8003d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.703639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54227754-66d1-4e40-a5d8-fd3a1a8003d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:44.705188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54227754-66d1-4e40-a5d8-fd3a1a8003d9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:44.715505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1256/2526] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:51:44.719900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecf69b-b4f5-4e10-8ff1-cbe4685228f9 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:44.730318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecf69b-b4f5-4e10-8ff1-cbe4685228f9 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:44.734869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:44.735512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.735801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.736061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] PATH_INFO: `/v3/projects/ad6abc6da8fc472b8c56aab9056c0fc1/users/2a2ae648558b48a987c07331e6c93204/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.751080 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6abc6da8fc472b8c56aab9056c0fc1, user_id=2a2ae648558b48a987c07331e6c93204, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:44.753712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:44.829657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1271/2527] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:44 2022] PUT /identity/v3/projects/ad6abc6da8fc472b8c56aab9056c0fc1/users/2a2ae648558b48a987c07331e6c93204/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:51:44.840121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a7b7c-0599-4e7d-a775-e50b334ee724 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:44.840411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a7b7c-0599-4e7d-a775-e50b334ee724 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:44.840689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a7b7c-0599-4e7d-a775-e50b334ee724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:44.869467 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-610a7b7c-0599-4e7d-a775-e50b334ee724 None None] MFA Rules not processed for user `2a2ae648558b48a987c07331e6c93204`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:44.870804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-610a7b7c-0599-4e7d-a775-e50b334ee724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:44.935547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1257/2528] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:44.947754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:44.950610 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:45.008426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810acee0-8166-4db7-b9db-5112532fed82 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:45.012177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373399c-bc82-470e-8798-5d8f72c6f413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:45.012781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373399c-bc82-470e-8798-5d8f72c6f413 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:45.013061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373399c-bc82-470e-8798-5d8f72c6f413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:45.013334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373399c-bc82-470e-8798-5d8f72c6f413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:45.022320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373399c-bc82-470e-8798-5d8f72c6f413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:45.023785 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373399c-bc82-470e-8798-5d8f72c6f413 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:45.033104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1272/2529] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:45.053470 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a7b7c-0599-4e7d-a775-e50b334ee724 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:45.116582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a7b7c-0599-4e7d-a775-e50b334ee724 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:45.121447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:45.122080 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:45.122352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:45.122649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] PATH_INFO: `/v3/users/2a2ae648558b48a987c07331e6c93204` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:45.123817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2ae648558b48a987c07331e6c93204)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:45.125851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:45.253696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:45.265919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2ae648558b48a987c07331e6c93204'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:45.303818 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2ae648558b48a987c07331e6c93204'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:45.311011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2ae648558b48a987c07331e6c93204'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:45.322571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2ae648558b48a987c07331e6c93204'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:45.323244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2ae648558b48a987c07331e6c93204'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:45.329093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1258/2530] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:51:45 2022] DELETE /identity/v3/users/2a2ae648558b48a987c07331e6c93204 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:45.333826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2227a1-dbe8-4fed-87e2-488a30e6351b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:45.334288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2227a1-dbe8-4fed-87e2-488a30e6351b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:45.334387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2227a1-dbe8-4fed-87e2-488a30e6351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:45.353190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-2b2227a1-dbe8-4fed-87e2-488a30e6351b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:45.354399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2b2227a1-dbe8-4fed-87e2-488a30e6351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:45.413019 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1273/2531] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:51:45.422729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:45.424786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:45.481758 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c0d72-9821-4266-a165-7bfd9a7495f5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:45.485536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4814a98-f096-43c9-a0aa-744f86d962a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:45.486153 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4814a98-f096-43c9-a0aa-744f86d962a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:45.486426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4814a98-f096-43c9-a0aa-744f86d962a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:45.486795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4814a98-f096-43c9-a0aa-744f86d962a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:45.496240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4814a98-f096-43c9-a0aa-744f86d962a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:45.499929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4814a98-f096-43c9-a0aa-744f86d962a4 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:45.507028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1259/2532] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:51:45.912618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2227a1-dbe8-4fed-87e2-488a30e6351b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:45.914139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2b2227a1-dbe8-4fed-87e2-488a30e6351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:45.930996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2227a1-dbe8-4fed-87e2-488a30e6351b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:45.935824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:45.936481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:45.936761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:45.937035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] PATH_INFO: `/v3/projects/ad6abc6da8fc472b8c56aab9056c0fc1` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:45.938188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6abc6da8fc472b8c56aab9056c0fc1)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:45.940198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:46.058397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6abc6da8fc472b8c56aab9056c0fc1', 'request_id': 'req-b31213c8-e68f-43c6-9e03-3b434d23fbf8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:46.063948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6abc6da8fc472b8c56aab9056c0fc1', 'request_id': 'req-b31213c8-e68f-43c6-9e03-3b434d23fbf8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:46.070219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6abc6da8fc472b8c56aab9056c0fc1', 'request_id': 'req-b31213c8-e68f-43c6-9e03-3b434d23fbf8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:46.072726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:46.159832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] The token cache is being invalidate because project ad6abc6da8fc472b8c56aab9056c0fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:51:46.160121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:46.161261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b31213c8-e68f-43c6-9e03-3b434d23fbf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:51:46.162798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1274/2533] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:51:45 2022] DELETE /identity/v3/projects/ad6abc6da8fc472b8c56aab9056c0fc1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:46.167712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1378d-9274-4e0b-8725-cecda30dff59 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.167998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1378d-9274-4e0b-8725-cecda30dff59 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.168270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1378d-9274-4e0b-8725-cecda30dff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.187648 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-75a1378d-9274-4e0b-8725-cecda30dff59 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:46.188881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-75a1378d-9274-4e0b-8725-cecda30dff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:46.248235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1260/2534] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:46.257302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817dd1d-4af1-4ee0-bbde-afc2aac48a4e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.257593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817dd1d-4af1-4ee0-bbde-afc2aac48a4e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.257873 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817dd1d-4af1-4ee0-bbde-afc2aac48a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.278277 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-f817dd1d-4af1-4ee0-bbde-afc2aac48a4e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:46.279492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f817dd1d-4af1-4ee0-bbde-afc2aac48a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:46.287652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1275/2535] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:46.292155 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1378d-9274-4e0b-8725-cecda30dff59 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:46.303310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1378d-9274-4e0b-8725-cecda30dff59 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:46.308086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:46.308688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.308964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.309236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.309889 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:51:46.310199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:46.311838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:46.324345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1261/2536] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:51:46.328733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817dd1d-4af1-4ee0-bbde-afc2aac48a4e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:46.338573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817dd1d-4af1-4ee0-bbde-afc2aac48a4e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:46.343551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853ae48-7f4c-4538-b3c2-103d328f5b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:46.344164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ae48-7f4c-4538-b3c2-103d328f5b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.344442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ae48-7f4c-4538-b3c2-103d328f5b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.344713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ae48-7f4c-4538-b3c2-103d328f5b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.345421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853ae48-7f4c-4538-b3c2-103d328f5b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:46.347330 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853ae48-7f4c-4538-b3c2-103d328f5b84 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:46.431731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1276/2537] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:51:46 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:51:46.435784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:46.446393 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6906c-6e74-49c5-ad38-874b9b4df8e9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:46.483658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:46.502217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa71e-da8b-4d30-9e89-eb6948db73fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:46.502849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa71e-da8b-4d30-9e89-eb6948db73fc admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.503189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa71e-da8b-4d30-9e89-eb6948db73fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.503466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa71e-da8b-4d30-9e89-eb6948db73fc admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.504098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aa71e-da8b-4d30-9e89-eb6948db73fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:46.506754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aa71e-da8b-4d30-9e89-eb6948db73fc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:46.635498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1262/2538] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:51:46 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:51:46.639477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853ae48-7f4c-4538-b3c2-103d328f5b84 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:46.650037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853ae48-7f4c-4538-b3c2-103d328f5b84 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:46.654813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd3262-f2df-4765-9053-bd9b692065ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:46.655696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3262-f2df-4765-9053-bd9b692065ad admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.655696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3262-f2df-4765-9053-bd9b692065ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.655928 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3262-f2df-4765-9053-bd9b692065ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.656596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd3262-f2df-4765-9053-bd9b692065ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:46.658197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd3262-f2df-4765-9053-bd9b692065ad admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:46.668468 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1277/2539] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:46.672301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa71e-da8b-4d30-9e89-eb6948db73fc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:46.682692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa71e-da8b-4d30-9e89-eb6948db73fc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:46.687363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438e4d1-2461-4c89-a7c1-8aaffc229b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:46.687946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438e4d1-2461-4c89-a7c1-8aaffc229b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.688222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438e4d1-2461-4c89-a7c1-8aaffc229b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.688490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438e4d1-2461-4c89-a7c1-8aaffc229b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.689125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438e4d1-2461-4c89-a7c1-8aaffc229b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:46.690744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438e4d1-2461-4c89-a7c1-8aaffc229b46 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:46.701017 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1263/2540] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:51:46.705351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd3262-f2df-4765-9053-bd9b692065ad admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:46.715108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd3262-f2df-4765-9053-bd9b692065ad admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:46.719954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:46.721200 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.722638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.722638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] PATH_INFO: `/v3/projects/8dc88dc1ba944634a3c71217c21ba3e3/users/b71db3ab907649cebe39f62ecc5ab085/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.736355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc88dc1ba944634a3c71217c21ba3e3, user_id=b71db3ab907649cebe39f62ecc5ab085, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:46.739111 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:46.811881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1278/2541] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:51:46 2022] PUT /identity/v3/projects/8dc88dc1ba944634a3c71217c21ba3e3/users/b71db3ab907649cebe39f62ecc5ab085/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:51:46.822128 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f3e9-ee05-47e4-a669-6c53803b7490 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.822414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f3e9-ee05-47e4-a669-6c53803b7490 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.822720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f3e9-ee05-47e4-a669-6c53803b7490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.850731 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7d01f3e9-ee05-47e4-a669-6c53803b7490 None None] MFA Rules not processed for user `b71db3ab907649cebe39f62ecc5ab085`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:51:46.851970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7d01f3e9-ee05-47e4-a669-6c53803b7490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:46.915323 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1264/2542] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:51:46.926017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:46.928331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:46.985508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd724-7e13-4ce8-b723-6d585ba48e78 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:46.989120 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bd15f-ddf9-4e49-8957-2062202e90d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb458a6186814aadb4ef178ff199582c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:46.990271 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bd15f-ddf9-4e49-8957-2062202e90d6 service glance] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:46.990572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bd15f-ddf9-4e49-8957-2062202e90d6 service glance] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:46.990847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bd15f-ddf9-4e49-8957-2062202e90d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:46.998920 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bd15f-ddf9-4e49-8957-2062202e90d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:47.000341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bd15f-ddf9-4e49-8957-2062202e90d6 service glance] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:47.010279 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1279/2543] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:54.794303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01f3e9-ee05-47e4-a669-6c53803b7490 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:54.795760 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7d01f3e9-ee05-47e4-a669-6c53803b7490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:54.853425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01f3e9-ee05-47e4-a669-6c53803b7490 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:54.857036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:54.857639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:54.857922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:54.858195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:54.859936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:54.926578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:54.930086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:54.932591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:54.939220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1265/2544] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:51:56.890489 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bd15f-ddf9-4e49-8957-2062202e90d6 service glance] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:51:56.900037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bd15f-ddf9-4e49-8957-2062202e90d6 service glance] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:51:56.903741 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4bb83-4240-495d-b107-51933b2daf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:51:56.904453 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4bb83-4240-495d-b107-51933b2daf4e service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:51:56.904797 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4bb83-4240-495d-b107-51933b2daf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:51:56.905124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4bb83-4240-495d-b107-51933b2daf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:51:56.907620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-acc4bb83-4240-495d-b107-51933b2daf4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:51:56.918177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4bb83-4240-495d-b107-51933b2daf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:51:56.919663 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4bb83-4240-495d-b107-51933b2daf4e service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:51:56.930555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1280/2545] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:51:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:52:05.052093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:06.925058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:DELETE=1,keystone:SELECT=61,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:16.008325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:16.078322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899269-41c2-4e42-9dde-b9091d165999 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:16.083008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:16.085958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:16.085958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:16.085958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] PATH_INFO: `/v3/users/b71db3ab907649cebe39f62ecc5ab085` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:16.085958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b71db3ab907649cebe39f62ecc5ab085)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:16.087322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:16.233853 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b71db3ab907649cebe39f62ecc5ab085'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:16.303084 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b71db3ab907649cebe39f62ecc5ab085'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:16.310345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b71db3ab907649cebe39f62ecc5ab085'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:16.321872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b71db3ab907649cebe39f62ecc5ab085'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:16.322527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b71db3ab907649cebe39f62ecc5ab085'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:16.328374 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1266/2546] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:52:16 2022] DELETE /identity/v3/users/b71db3ab907649cebe39f62ecc5ab085 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:16.332956 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c613a-f92d-469d-b6dc-baf56c59b49a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:16.333439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c613a-f92d-469d-b6dc-baf56c59b49a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:16.333536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c613a-f92d-469d-b6dc-baf56c59b49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:16.354877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-645c613a-f92d-469d-b6dc-baf56c59b49a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:16.356738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-645c613a-f92d-469d-b6dc-baf56c59b49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:16.423487 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1281/2547] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:16.433271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:16.434775 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:16.495932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818b97-13c2-48db-aedb-8ae7f744b6a8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:16.500022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba825464-2aeb-4b1c-8bdd-1d937bf7ff98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:16.500860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba825464-2aeb-4b1c-8bdd-1d937bf7ff98 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:16.501204 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba825464-2aeb-4b1c-8bdd-1d937bf7ff98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:16.501585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba825464-2aeb-4b1c-8bdd-1d937bf7ff98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:16.512613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba825464-2aeb-4b1c-8bdd-1d937bf7ff98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:16.514257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba825464-2aeb-4b1c-8bdd-1d937bf7ff98 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:16.525719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1267/2548] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:52:16.904979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c613a-f92d-469d-b6dc-baf56c59b49a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:16.906619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-645c613a-f92d-469d-b6dc-baf56c59b49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:16.919425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c613a-f92d-469d-b6dc-baf56c59b49a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:16.928745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:16.929422 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:16.929852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:16.929947 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] PATH_INFO: `/v3/projects/8dc88dc1ba944634a3c71217c21ba3e3` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:16.939138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc88dc1ba944634a3c71217c21ba3e3)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:16.939138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:17.063042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc88dc1ba944634a3c71217c21ba3e3', 'request_id': 'req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:17.068300 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc88dc1ba944634a3c71217c21ba3e3', 'request_id': 'req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:17.075114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc88dc1ba944634a3c71217c21ba3e3', 'request_id': 'req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:17.164398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] The token cache is being invalidate because project 8dc88dc1ba944634a3c71217c21ba3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:52:17.164570 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:17.165184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-7c56936b-5a61-4b7b-bb2c-9b29d84a6442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:17.166774 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1282/2549] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:52:16 2022] DELETE /identity/v3/projects/8dc88dc1ba944634a3c71217c21ba3e3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:17.171791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ee61-b42a-4541-a4ff-ea35ae341b0e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.172297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ee61-b42a-4541-a4ff-ea35ae341b0e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.172407 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ee61-b42a-4541-a4ff-ea35ae341b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.193522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b094ee61-b42a-4541-a4ff-ea35ae341b0e None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:17.195195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b094ee61-b42a-4541-a4ff-ea35ae341b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:17.212365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:17.254697 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1268/2550] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:17.264262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf257f2-b245-4598-8970-4538edaae7b6 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.264735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf257f2-b245-4598-8970-4538edaae7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.265263 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf257f2-b245-4598-8970-4538edaae7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.288368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1cf257f2-b245-4598-8970-4538edaae7b6 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:17.289613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1cf257f2-b245-4598-8970-4538edaae7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:17.297665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1283/2551] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:17.301878 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094ee61-b42a-4541-a4ff-ea35ae341b0e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:17.311817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094ee61-b42a-4541-a4ff-ea35ae341b0e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:17.316477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:17.317076 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.317355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.317623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.318295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:52:17.318632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:17.320342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:17.332668 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1269/2552] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:52:17.337618 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf257f2-b245-4598-8970-4538edaae7b6 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:17.346221 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf257f2-b245-4598-8970-4538edaae7b6 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:17.350989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee0eba-bb47-4d1e-ae92-d43515123d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:17.351634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee0eba-bb47-4d1e-ae92-d43515123d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.351918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee0eba-bb47-4d1e-ae92-d43515123d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.352588 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee0eba-bb47-4d1e-ae92-d43515123d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.352799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee0eba-bb47-4d1e-ae92-d43515123d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:17.355293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee0eba-bb47-4d1e-ae92-d43515123d5a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:17.441232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1284/2553] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:52:17 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:52:17.445524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:17.455559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66300d-70e9-4340-ba02-ed2292207c91 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:17.511152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be318e-172d-4dc0-9673-fc347f2e7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:17.511754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be318e-172d-4dc0-9673-fc347f2e7c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.512037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be318e-172d-4dc0-9673-fc347f2e7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.512309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be318e-172d-4dc0-9673-fc347f2e7c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.512974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be318e-172d-4dc0-9673-fc347f2e7c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:17.514914 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be318e-172d-4dc0-9673-fc347f2e7c89 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:17.582361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1270/2554] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:52:17 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:17.586413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee0eba-bb47-4d1e-ae92-d43515123d5a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:17.596631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee0eba-bb47-4d1e-ae92-d43515123d5a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:17.601203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38406efb-3633-4704-bec7-2643d5c2c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:17.601791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406efb-3633-4704-bec7-2643d5c2c166 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.602065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406efb-3633-4704-bec7-2643d5c2c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.602329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38406efb-3633-4704-bec7-2643d5c2c166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.603003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38406efb-3633-4704-bec7-2643d5c2c166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:17.605135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38406efb-3633-4704-bec7-2643d5c2c166 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:17.614921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1285/2555] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:17.618728 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be318e-172d-4dc0-9673-fc347f2e7c89 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:17.629310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be318e-172d-4dc0-9673-fc347f2e7c89 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:17.633949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b0d30-9abf-442a-8ed2-e3c4f4195efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:17.634571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0d30-9abf-442a-8ed2-e3c4f4195efa admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.634851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0d30-9abf-442a-8ed2-e3c4f4195efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.635121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b0d30-9abf-442a-8ed2-e3c4f4195efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.635788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b0d30-9abf-442a-8ed2-e3c4f4195efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:17.637372 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b0d30-9abf-442a-8ed2-e3c4f4195efa admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:17.647843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1271/2556] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:17.651644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38406efb-3633-4704-bec7-2643d5c2c166 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:17.661348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38406efb-3633-4704-bec7-2643d5c2c166 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:17.665857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3344-283a-4a3e-9e24-0ad0b5448c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:17.666506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3344-283a-4a3e-9e24-0ad0b5448c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.667281 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3344-283a-4a3e-9e24-0ad0b5448c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.667554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3344-283a-4a3e-9e24-0ad0b5448c04 admin admin] PATH_INFO: `/v3/projects/fd85b7e6bdbb4848b10cc35c10e59d50/users/f2d235337f8347c6b4232fbffa713a90/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.681368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3344-283a-4a3e-9e24-0ad0b5448c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd85b7e6bdbb4848b10cc35c10e59d50, user_id=f2d235337f8347c6b4232fbffa713a90, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:17.684635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3344-283a-4a3e-9e24-0ad0b5448c04 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:17.737124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1286/2557] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:52:17 2022] PUT /identity/v3/projects/fd85b7e6bdbb4848b10cc35c10e59d50/users/f2d235337f8347c6b4232fbffa713a90/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:52:17.750421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221699-75b0-4bd1-bd7f-45979cd84b51 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.750421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221699-75b0-4bd1-bd7f-45979cd84b51 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.750421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221699-75b0-4bd1-bd7f-45979cd84b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.785389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ac221699-75b0-4bd1-bd7f-45979cd84b51 None None] MFA Rules not processed for user `f2d235337f8347c6b4232fbffa713a90`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:17.785389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ac221699-75b0-4bd1-bd7f-45979cd84b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:17.850596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1272/2558] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:17.855858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3344-283a-4a3e-9e24-0ad0b5448c04 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:17.876922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:17.917755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3344-283a-4a3e-9e24-0ad0b5448c04 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:17.923224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff0542-930a-4ff8-8737-8897aad43cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:17.924534 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0542-930a-4ff8-8737-8897aad43cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:17.925305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0542-930a-4ff8-8737-8897aad43cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:17.925660 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff0542-930a-4ff8-8737-8897aad43cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:17.926364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff0542-930a-4ff8-8737-8897aad43cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:17.928388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff0542-930a-4ff8-8737-8897aad43cd2 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.035749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1287/2559] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:52:17 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:52:18.040056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac221699-75b0-4bd1-bd7f-45979cd84b51 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.051387 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac221699-75b0-4bd1-bd7f-45979cd84b51 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:18.063455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:18.105774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19f15-bfcb-4c66-aaa1-f6f0fa9888e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:18.106371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19f15-bfcb-4c66-aaa1-f6f0fa9888e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.106675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19f15-bfcb-4c66-aaa1-f6f0fa9888e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.106976 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19f15-bfcb-4c66-aaa1-f6f0fa9888e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.107601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a19f15-bfcb-4c66-aaa1-f6f0fa9888e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:18.109515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a19f15-bfcb-4c66-aaa1-f6f0fa9888e7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.217299 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1273/2560] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:52:18 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:18.221393 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff0542-930a-4ff8-8737-8897aad43cd2 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.231758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff0542-930a-4ff8-8737-8897aad43cd2 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:18.236420 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbe905-45f1-441d-9da4-5b52199019fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:18.237015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbe905-45f1-441d-9da4-5b52199019fc admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.237294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbe905-45f1-441d-9da4-5b52199019fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.237567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbe905-45f1-441d-9da4-5b52199019fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.238228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbe905-45f1-441d-9da4-5b52199019fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:18.239866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbe905-45f1-441d-9da4-5b52199019fc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.250448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1288/2561] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:18.254419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19f15-bfcb-4c66-aaa1-f6f0fa9888e7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.264848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19f15-bfcb-4c66-aaa1-f6f0fa9888e7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:18.269628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e6c45-fdca-4d24-a850-8391bf7cb6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:18.270215 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e6c45-fdca-4d24-a850-8391bf7cb6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.270516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e6c45-fdca-4d24-a850-8391bf7cb6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.270789 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e6c45-fdca-4d24-a850-8391bf7cb6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.271425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e6c45-fdca-4d24-a850-8391bf7cb6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:18.273004 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e6c45-fdca-4d24-a850-8391bf7cb6bc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.283541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1274/2562] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:18.287513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbe905-45f1-441d-9da4-5b52199019fc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.297194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbe905-45f1-441d-9da4-5b52199019fc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:18.301875 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5ac2-9110-4512-9b4e-bc9b834711c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:18.302537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5ac2-9110-4512-9b4e-bc9b834711c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.302812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5ac2-9110-4512-9b4e-bc9b834711c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.303084 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5ac2-9110-4512-9b4e-bc9b834711c6 admin admin] PATH_INFO: `/v3/projects/5a95174f2ecb481e80f17d731243be7a/users/a3836689336c40db9bc533d2292d99f5/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.317439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc5ac2-9110-4512-9b4e-bc9b834711c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a95174f2ecb481e80f17d731243be7a, user_id=a3836689336c40db9bc533d2292d99f5, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:18.320134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc5ac2-9110-4512-9b4e-bc9b834711c6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.377226 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1289/2563] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:52:18 2022] PUT /identity/v3/projects/5a95174f2ecb481e80f17d731243be7a/users/a3836689336c40db9bc533d2292d99f5/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:18.388121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb307ba-6e33-45cf-8c81-416420c5d6a1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.388403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb307ba-6e33-45cf-8c81-416420c5d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.388673 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb307ba-6e33-45cf-8c81-416420c5d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.416580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4cb307ba-6e33-45cf-8c81-416420c5d6a1 None None] MFA Rules not processed for user `a3836689336c40db9bc533d2292d99f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:18.417800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4cb307ba-6e33-45cf-8c81-416420c5d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:18.480833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1275/2564] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:18.485388 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5ac2-9110-4512-9b4e-bc9b834711c6 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.548352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5ac2-9110-4512-9b4e-bc9b834711c6 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:18.553551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056a24-8fc8-4fd1-bba4-14cdee0ad286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:18.554197 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056a24-8fc8-4fd1-bba4-14cdee0ad286 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.554459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056a24-8fc8-4fd1-bba4-14cdee0ad286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.554753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056a24-8fc8-4fd1-bba4-14cdee0ad286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.555387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056a24-8fc8-4fd1-bba4-14cdee0ad286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:18.557771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056a24-8fc8-4fd1-bba4-14cdee0ad286 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.680603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1290/2565] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:52:18 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:52:18.685225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb307ba-6e33-45cf-8c81-416420c5d6a1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.696601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb307ba-6e33-45cf-8c81-416420c5d6a1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:18.750907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1d92-c883-4b8f-893a-0916472edc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:18.751433 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1d92-c883-4b8f-893a-0916472edc43 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.751704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1d92-c883-4b8f-893a-0916472edc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.751969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1d92-c883-4b8f-893a-0916472edc43 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.752601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b1d92-c883-4b8f-893a-0916472edc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:18.754549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b1d92-c883-4b8f-893a-0916472edc43 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.828734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1276/2566] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:52:18 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:18.832742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056a24-8fc8-4fd1-bba4-14cdee0ad286 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.843077 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056a24-8fc8-4fd1-bba4-14cdee0ad286 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:18.847677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8ae4e-7af7-4401-9c64-7e4968b2026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:18.848265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8ae4e-7af7-4401-9c64-7e4968b2026a admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.848544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8ae4e-7af7-4401-9c64-7e4968b2026a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.848816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8ae4e-7af7-4401-9c64-7e4968b2026a admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.849454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8ae4e-7af7-4401-9c64-7e4968b2026a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:18.851096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8ae4e-7af7-4401-9c64-7e4968b2026a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.861848 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1291/2567] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:18.871817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1d92-c883-4b8f-893a-0916472edc43 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.881756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1d92-c883-4b8f-893a-0916472edc43 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:18.886370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9157136-adb1-4f78-978b-e077b75b3a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:18.887048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9157136-adb1-4f78-978b-e077b75b3a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:18.887357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9157136-adb1-4f78-978b-e077b75b3a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:18.887629 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9157136-adb1-4f78-978b-e077b75b3a61 admin admin] PATH_INFO: `/v3/projects/67cb2bfeeede49bda2c76ad71196324e/users/17ceaa4357294493b13623254c895b4b/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:18.899527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:18.902459 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9157136-adb1-4f78-978b-e077b75b3a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cb2bfeeede49bda2c76ad71196324e, user_id=17ceaa4357294493b13623254c895b4b, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:18.905125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9157136-adb1-4f78-978b-e077b75b3a61 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:18.966173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1277/2568] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:52:18 2022] PUT /identity/v3/projects/67cb2bfeeede49bda2c76ad71196324e/users/17ceaa4357294493b13623254c895b4b/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:18.970181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8ae4e-7af7-4401-9c64-7e4968b2026a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:18.980656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8ae4e-7af7-4401-9c64-7e4968b2026a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:19.023781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:19.045096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:19.045701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:19.045976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:19.046242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:19.047076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:19.048674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:19.061847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1292/2569] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:19.065863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9157136-adb1-4f78-978b-e077b75b3a61 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:19.075887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:19.076195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9157136-adb1-4f78-978b-e077b75b3a61 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:19.077709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:19.080982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc787286-d8dd-4d0c-a8e4-97b4a441e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:19.081638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787286-d8dd-4d0c-a8e4-97b4a441e98b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:19.081913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787286-d8dd-4d0c-a8e4-97b4a441e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:19.082183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787286-d8dd-4d0c-a8e4-97b4a441e98b admin admin] PATH_INFO: `/v3/projects/67cb2bfeeede49bda2c76ad71196324e/users/17ceaa4357294493b13623254c895b4b/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:19.084290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc787286-d8dd-4d0c-a8e4-97b4a441e98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cb2bfeeede49bda2c76ad71196324e, user_id=17ceaa4357294493b13623254c895b4b, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:19.086871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc787286-d8dd-4d0c-a8e4-97b4a441e98b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:19.097375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1278/2570] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:52:19 2022] PUT /identity/v3/projects/67cb2bfeeede49bda2c76ad71196324e/users/17ceaa4357294493b13623254c895b4b/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:52:19.138260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ef5c-d3aa-44f9-a5ff-22afe5ed1451 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:19.165947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba481-7b76-485c-9194-30a9fd0cfed6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:19.166220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba481-7b76-485c-9194-30a9fd0cfed6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:19.166514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ba481-7b76-485c-9194-30a9fd0cfed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:19.190654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:19.193351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:19.193351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:19.193351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:19.193654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:19.194518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-165ba481-7b76-485c-9194-30a9fd0cfed6 None None] MFA Rules not processed for user `17ceaa4357294493b13623254c895b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:19.195726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-165ba481-7b76-485c-9194-30a9fd0cfed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:19.256097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:19.257442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:19.268014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1279/2571] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:52:19.268769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1293/2572] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:52:19.280093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ba481-7b76-485c-9194-30a9fd0cfed6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:19.281454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-165ba481-7b76-485c-9194-30a9fd0cfed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:19.342725 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ba481-7b76-485c-9194-30a9fd0cfed6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:19.346751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:19.347362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:19.347633 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:19.347896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:19.407360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:19.408807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:19.418563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1280/2573] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:52:22.423827 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:22.433935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24535b1-e36b-4e8d-9d4a-b869eeb74394 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:22.437721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc946b9-91f1-4fc5-a83d-abd49aae5acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:22.438384 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc946b9-91f1-4fc5-a83d-abd49aae5acc service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:22.444841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc946b9-91f1-4fc5-a83d-abd49aae5acc service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:22.444841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc946b9-91f1-4fc5-a83d-abd49aae5acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:22.487878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:22.504338 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc946b9-91f1-4fc5-a83d-abd49aae5acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:22.505768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc946b9-91f1-4fc5-a83d-abd49aae5acc service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:22.515310 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1294/2574] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:52:22.644652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:22.646146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:22.660806 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d13a02-e688-403d-bdbd-8561904b5d4d service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:22.665714 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:22.666354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:22.666665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:22.667501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] PATH_INFO: `/v3/users/0c316e7b121b4d859d9677edcb49be45` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:22.681693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c316e7b121b4d859d9677edcb49be45)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:22.684355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:22.685840 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:22.869754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c316e7b121b4d859d9677edcb49be45'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:22.937043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c316e7b121b4d859d9677edcb49be45'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:22.944738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c316e7b121b4d859d9677edcb49be45'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:22.956325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c316e7b121b4d859d9677edcb49be45'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:22.957008 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e74cff33-0e3e-4998-b342-610459de4942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c316e7b121b4d859d9677edcb49be45'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:22.963123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1281/2575] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:52:22 2022] DELETE /identity/v3/users/0c316e7b121b4d859d9677edcb49be45 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:23.236156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc946b9-91f1-4fc5-a83d-abd49aae5acc service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:23.248891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc946b9-91f1-4fc5-a83d-abd49aae5acc service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:23.307818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:23.308351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:23.308625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:23.308891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] PATH_INFO: `/v3/projects/a1554973bf4b4523b966a9d851b0244a` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:23.320190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1554973bf4b4523b966a9d851b0244a)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:23.322278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:23.423112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1554973bf4b4523b966a9d851b0244a', 'request_id': 'req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:23.428947 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1554973bf4b4523b966a9d851b0244a', 'request_id': 'req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:23.435546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1554973bf4b4523b966a9d851b0244a', 'request_id': 'req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:23.501925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] The token cache is being invalidate because project a1554973bf4b4523b966a9d851b0244a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:52:23.502326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:23.502970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-382d54d0-39ee-471c-b2cc-3eea93c6f5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:23.504532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1295/2576] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:52:23 2022] DELETE /identity/v3/projects/a1554973bf4b4523b966a9d851b0244a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:23.509481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935692c0-51c7-4301-89d0-547b728a36bb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:23.509769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935692c0-51c7-4301-89d0-547b728a36bb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:23.510048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935692c0-51c7-4301-89d0-547b728a36bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:23.530075 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-935692c0-51c7-4301-89d0-547b728a36bb None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:23.531309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-935692c0-51c7-4301-89d0-547b728a36bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:23.591602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1282/2577] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:23.599404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c787-f0b9-4f85-978d-0e16b199f3f4 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:23.599688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c787-f0b9-4f85-978d-0e16b199f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:23.599986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c787-f0b9-4f85-978d-0e16b199f3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:23.619606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-18c9c787-f0b9-4f85-978d-0e16b199f3f4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:23.621434 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-18c9c787-f0b9-4f85-978d-0e16b199f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:23.629258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1296/2578] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:23.633397 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935692c0-51c7-4301-89d0-547b728a36bb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:23.642917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935692c0-51c7-4301-89d0-547b728a36bb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:23.647799 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:23.648445 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:23.648808 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:23.649086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:23.649733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:52:23.650037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:23.651689 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:23.663029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1283/2579] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:52:23.668067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c787-f0b9-4f85-978d-0e16b199f3f4 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:23.677315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c787-f0b9-4f85-978d-0e16b199f3f4 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:23.681962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:23.685058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:23.685058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:23.685058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:23.685058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:23.686137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:23.794905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1297/2580] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:52:23 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:23.795220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:23.801804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426889d-e037-4ea1-b856-61071d7635ee admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:23.871644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4c94d-79ac-4b31-8a7b-7c5b9a5cdc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:23.872248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4c94d-79ac-4b31-8a7b-7c5b9a5cdc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:23.872531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4c94d-79ac-4b31-8a7b-7c5b9a5cdc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:23.872896 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4c94d-79ac-4b31-8a7b-7c5b9a5cdc65 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:23.873528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4c94d-79ac-4b31-8a7b-7c5b9a5cdc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:23.875584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4c94d-79ac-4b31-8a7b-7c5b9a5cdc65 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:23.887246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:23.890606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:23.892308 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:23.933919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:23.950755 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a003-97ff-4806-a2c5-4c9b51f129df admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:23.954370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:23.958103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:23.958103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:23.958103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:23.958103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:23.986801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1284/2581] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:52:23 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:23.988473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4c94d-79ac-4b31-8a7b-7c5b9a5cdc65 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:23.998123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4c94d-79ac-4b31-8a7b-7c5b9a5cdc65 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:24.003601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dacd2f-2825-4f92-9078-ed6232d94447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:24.004202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dacd2f-2825-4f92-9078-ed6232d94447 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:24.004483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dacd2f-2825-4f92-9078-ed6232d94447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:24.004756 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dacd2f-2825-4f92-9078-ed6232d94447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:24.005403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dacd2f-2825-4f92-9078-ed6232d94447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:24.007058 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dacd2f-2825-4f92-9078-ed6232d94447 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:24.018174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1285/2582] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:52:24.022341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dacd2f-2825-4f92-9078-ed6232d94447 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:24.027285 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:24.027585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:24.032600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dacd2f-2825-4f92-9078-ed6232d94447 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:24.037133 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1298/2583] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:52:24.037390 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7218-ec4c-40be-bf5c-802b39270a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:24.037983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7218-ec4c-40be-bf5c-802b39270a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:24.038392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7218-ec4c-40be-bf5c-802b39270a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:24.038701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7218-ec4c-40be-bf5c-802b39270a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:24.039466 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7218-ec4c-40be-bf5c-802b39270a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:24.041041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7218-ec4c-40be-bf5c-802b39270a6a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:24.053715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1286/2584] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:52:24.057905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:24.068354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0934bb-9a80-4b78-b1ee-147d2500aea9 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:24.073250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d060a6-0aa8-40af-a9e9-36ea9710856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:24.074135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d060a6-0aa8-40af-a9e9-36ea9710856d admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:24.074826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d060a6-0aa8-40af-a9e9-36ea9710856d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:24.075147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d060a6-0aa8-40af-a9e9-36ea9710856d admin admin] PATH_INFO: `/v3/projects/74d1ff301f984303863d1c0bd0ddf9bf/users/1e26cd3e38254ac6aa4df360e5006519/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:24.091211 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d060a6-0aa8-40af-a9e9-36ea9710856d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d1ff301f984303863d1c0bd0ddf9bf, user_id=1e26cd3e38254ac6aa4df360e5006519, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:24.093923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d060a6-0aa8-40af-a9e9-36ea9710856d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:24.171126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1299/2585] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:52:24 2022] PUT /identity/v3/projects/74d1ff301f984303863d1c0bd0ddf9bf/users/1e26cd3e38254ac6aa4df360e5006519/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:24.182918 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e69c-eecb-45d1-9796-fba1d59e0bfd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:24.183209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e69c-eecb-45d1-9796-fba1d59e0bfd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:24.183489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e69c-eecb-45d1-9796-fba1d59e0bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:24.216229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3979e69c-eecb-45d1-9796-fba1d59e0bfd None None] MFA Rules not processed for user `1e26cd3e38254ac6aa4df360e5006519`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:24.217447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3979e69c-eecb-45d1-9796-fba1d59e0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:24.284137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1287/2586] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:24.288754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d060a6-0aa8-40af-a9e9-36ea9710856d admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:24.478058 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d060a6-0aa8-40af-a9e9-36ea9710856d admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:24.482870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608718-06e1-4ca3-9993-af4efa1e5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:24.483473 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608718-06e1-4ca3-9993-af4efa1e5146 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:24.483750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608718-06e1-4ca3-9993-af4efa1e5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:24.484068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608718-06e1-4ca3-9993-af4efa1e5146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:24.484694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608718-06e1-4ca3-9993-af4efa1e5146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:24.486642 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608718-06e1-4ca3-9993-af4efa1e5146 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:24.606859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1300/2587] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:52:24 2022] POST /identity/v3/projects => generated 371 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:24.610999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e69c-eecb-45d1-9796-fba1d59e0bfd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:24.622064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e69c-eecb-45d1-9796-fba1d59e0bfd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:24.677586 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a83de4-21c1-48c2-96a5-5d9a5b408f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:24.678230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a83de4-21c1-48c2-96a5-5d9a5b408f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:24.678517 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a83de4-21c1-48c2-96a5-5d9a5b408f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:24.678797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a83de4-21c1-48c2-96a5-5d9a5b408f0c admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:24.679410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a83de4-21c1-48c2-96a5-5d9a5b408f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:24.681358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a83de4-21c1-48c2-96a5-5d9a5b408f0c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:24.771331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1288/2588] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:52:24 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:24.775288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608718-06e1-4ca3-9993-af4efa1e5146 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:24.785481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608718-06e1-4ca3-9993-af4efa1e5146 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:24.790130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ec52-fddf-453b-adcb-855695cbe236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:24.790747 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ec52-fddf-453b-adcb-855695cbe236 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:24.791021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ec52-fddf-453b-adcb-855695cbe236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:24.791287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ec52-fddf-453b-adcb-855695cbe236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:24.791919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ec52-fddf-453b-adcb-855695cbe236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:24.793488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ec52-fddf-453b-adcb-855695cbe236 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:24.803602 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1301/2589] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:24.808280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a83de4-21c1-48c2-96a5-5d9a5b408f0c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:24.818240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a83de4-21c1-48c2-96a5-5d9a5b408f0c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:24.823715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbe17-bdcd-43c4-bad1-46afc1415e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:24.824346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbe17-bdcd-43c4-bad1-46afc1415e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:24.824626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbe17-bdcd-43c4-bad1-46afc1415e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:24.824898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbe17-bdcd-43c4-bad1-46afc1415e4f admin admin] PATH_INFO: `/v3/projects/3c12eeb3855d486cb2fb711e4e692956/users/c2a7c8886c734f56895c1dde0189f401/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:24.842046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafbe17-bdcd-43c4-bad1-46afc1415e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c12eeb3855d486cb2fb711e4e692956, user_id=c2a7c8886c734f56895c1dde0189f401, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:24.844767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafbe17-bdcd-43c4-bad1-46afc1415e4f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:24.983841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1289/2590] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:52:24 2022] PUT /identity/v3/projects/3c12eeb3855d486cb2fb711e4e692956/users/c2a7c8886c734f56895c1dde0189f401/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:24.987740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ec52-fddf-453b-adcb-855695cbe236 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:24.998332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ec52-fddf-453b-adcb-855695cbe236 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:25.030809 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:25.053141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82279092-00e4-4b5f-b02a-6b8b7bc64ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:25.058191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279092-00e4-4b5f-b02a-6b8b7bc64ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:25.058191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279092-00e4-4b5f-b02a-6b8b7bc64ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:25.058191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279092-00e4-4b5f-b02a-6b8b7bc64ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:25.058191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82279092-00e4-4b5f-b02a-6b8b7bc64ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:25.058191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82279092-00e4-4b5f-b02a-6b8b7bc64ec9 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:25.066676 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1302/2591] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:25.071018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbe17-bdcd-43c4-bad1-46afc1415e4f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:25.081227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbe17-bdcd-43c4-bad1-46afc1415e4f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:25.092064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e8fb-8972-45b8-82bc-653b8436f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:25.092064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e8fb-8972-45b8-82bc-653b8436f89b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:25.092064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e8fb-8972-45b8-82bc-653b8436f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:25.092064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e8fb-8972-45b8-82bc-653b8436f89b admin admin] PATH_INFO: `/v3/projects/3c12eeb3855d486cb2fb711e4e692956/users/c2a7c8886c734f56895c1dde0189f401/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:25.092472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75e8fb-8972-45b8-82bc-653b8436f89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c12eeb3855d486cb2fb711e4e692956, user_id=c2a7c8886c734f56895c1dde0189f401, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:25.092472 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75e8fb-8972-45b8-82bc-653b8436f89b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:25.103328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1290/2592] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:52:25 2022] PUT /identity/v3/projects/3c12eeb3855d486cb2fb711e4e692956/users/c2a7c8886c734f56895c1dde0189f401/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:25.113790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803d23-9d09-4ad5-aa66-208e8404f40b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:25.114074 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803d23-9d09-4ad5-aa66-208e8404f40b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:25.114344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803d23-9d09-4ad5-aa66-208e8404f40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:25.141563 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ad803d23-9d09-4ad5-aa66-208e8404f40b None None] MFA Rules not processed for user `c2a7c8886c734f56895c1dde0189f401`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:25.142791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ad803d23-9d09-4ad5-aa66-208e8404f40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:25.211298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1303/2593] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:25.223486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e8fb-8972-45b8-82bc-653b8436f89b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:25.241747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:25.284202 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e8fb-8972-45b8-82bc-653b8436f89b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:25.288122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:25.288727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:25.289154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:25.289410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:25.300425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:25.301957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:25.311899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1291/2594] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:52:25.510032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad803d23-9d09-4ad5-aa66-208e8404f40b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:25.519718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad803d23-9d09-4ad5-aa66-208e8404f40b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:25.523370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfca1f4-dfaa-40d1-a865-9bb5e7a263d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:25.524011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca1f4-dfaa-40d1-a865-9bb5e7a263d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:25.524290 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca1f4-dfaa-40d1-a865-9bb5e7a263d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:25.524560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca1f4-dfaa-40d1-a865-9bb5e7a263d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:25.580715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfca1f4-dfaa-40d1-a865-9bb5e7a263d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:25.586666 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfca1f4-dfaa-40d1-a865-9bb5e7a263d9 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:25.592697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1304/2595] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:52:29.640165 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:29.641563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:29.706063 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b75479-def5-4ae2-bd20-edf32137d3eb service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:29.710596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:29.711224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:29.711503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:29.711788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] PATH_INFO: `/v3/users/f2d235337f8347c6b4232fbffa713a90` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:29.712933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d235337f8347c6b4232fbffa713a90)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:29.714874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:29.911027 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d235337f8347c6b4232fbffa713a90'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:29.992680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d235337f8347c6b4232fbffa713a90'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:29.995462 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d235337f8347c6b4232fbffa713a90'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:30.007205 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d235337f8347c6b4232fbffa713a90'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:30.007847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d235337f8347c6b4232fbffa713a90'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:30.013763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1292/2596] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:52:29 2022] DELETE /identity/v3/users/f2d235337f8347c6b4232fbffa713a90 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:30.018254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb436-15ed-427c-b8b5-caf091de2f7c None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:30.019006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb436-15ed-427c-b8b5-caf091de2f7c None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:30.019106 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb436-15ed-427c-b8b5-caf091de2f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:30.037955 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1bcfb436-15ed-427c-b8b5-caf091de2f7c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:30.039165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1bcfb436-15ed-427c-b8b5-caf091de2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:30.089227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:30.099162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1305/2597] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:30.109119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:30.110547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:30.152086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:30.167802 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b50379-3e1b-44ce-afec-a9f5fcdea8ef admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:30.171524 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01036580-ed44-4f82-8783-be5dfff68197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:30.172119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01036580-ed44-4f82-8783-be5dfff68197 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:30.172395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01036580-ed44-4f82-8783-be5dfff68197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:30.172664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01036580-ed44-4f82-8783-be5dfff68197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:30.181762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01036580-ed44-4f82-8783-be5dfff68197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:30.183221 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01036580-ed44-4f82-8783-be5dfff68197 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:30.192448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1293/2598] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:52:30.589339 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfb436-15ed-427c-b8b5-caf091de2f7c None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:30.590861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1bcfb436-15ed-427c-b8b5-caf091de2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:30.603224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfb436-15ed-427c-b8b5-caf091de2f7c None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:30.607815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:30.608441 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:30.608724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:30.608992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] PATH_INFO: `/v3/projects/fd85b7e6bdbb4848b10cc35c10e59d50` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:30.610176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd85b7e6bdbb4848b10cc35c10e59d50)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:30.614173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:30.794921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd85b7e6bdbb4848b10cc35c10e59d50', 'request_id': 'req-750e407f-d4e4-4d0a-b57f-db87893cf771'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:30.800377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd85b7e6bdbb4848b10cc35c10e59d50', 'request_id': 'req-750e407f-d4e4-4d0a-b57f-db87893cf771'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:30.806459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd85b7e6bdbb4848b10cc35c10e59d50', 'request_id': 'req-750e407f-d4e4-4d0a-b57f-db87893cf771'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:30.901763 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] The token cache is being invalidate because project fd85b7e6bdbb4848b10cc35c10e59d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:52:30.902029 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:30.902719 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:30.904192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1306/2599] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:52:30 2022] DELETE /identity/v3/projects/fd85b7e6bdbb4848b10cc35c10e59d50 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:30.908258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01036580-ed44-4f82-8783-be5dfff68197 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:30.917909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01036580-ed44-4f82-8783-be5dfff68197 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:30.974037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:30.974682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:30.974965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:30.975231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] PATH_INFO: `/v3/users/a3836689336c40db9bc533d2292d99f5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:30.976362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3836689336c40db9bc533d2292d99f5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:30.978232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:31.109913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3836689336c40db9bc533d2292d99f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.153828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3836689336c40db9bc533d2292d99f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.160992 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3836689336c40db9bc533d2292d99f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.172985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3836689336c40db9bc533d2292d99f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.173618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3836689336c40db9bc533d2292d99f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.179754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1294/2600] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:52:30 2022] DELETE /identity/v3/users/a3836689336c40db9bc533d2292d99f5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:31.601598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:31.603123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:31.616550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e407f-d4e4-4d0a-b57f-db87893cf771 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:31.674040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:31.674694 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:31.674971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:31.675244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] PATH_INFO: `/v3/projects/5a95174f2ecb481e80f17d731243be7a` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:31.676364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a95174f2ecb481e80f17d731243be7a)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:31.678253 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:31.771240 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a95174f2ecb481e80f17d731243be7a', 'request_id': 'req-8da3b53b-31de-458b-b5cb-e7e142ceea5a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.776874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a95174f2ecb481e80f17d731243be7a', 'request_id': 'req-8da3b53b-31de-458b-b5cb-e7e142ceea5a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.783603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a95174f2ecb481e80f17d731243be7a', 'request_id': 'req-8da3b53b-31de-458b-b5cb-e7e142ceea5a'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.873090 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] The token cache is being invalidate because project 5a95174f2ecb481e80f17d731243be7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:52:31.873396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.874544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:31.876112 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1307/2601] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:52:31 2022] DELETE /identity/v3/projects/5a95174f2ecb481e80f17d731243be7a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:52:31.880013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:31.881386 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:31.895275 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebef7b-0d7f-416e-a6db-69b3293290d2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:31.950852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:31.951488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:31.952397 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:31.952678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] PATH_INFO: `/v3/users/17ceaa4357294493b13623254c895b4b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:31.953798 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ceaa4357294493b13623254c895b4b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:31.955729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:31.962819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:32.155724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ceaa4357294493b13623254c895b4b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.204882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ceaa4357294493b13623254c895b4b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.211734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ceaa4357294493b13623254c895b4b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.223943 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ceaa4357294493b13623254c895b4b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.224576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f15a33a-bdf8-413b-9155-13126e81b57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ceaa4357294493b13623254c895b4b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.230325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1295/2602] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:52:31 2022] DELETE /identity/v3/users/17ceaa4357294493b13623254c895b4b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:32.652692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:32.654180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:32.669556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3b53b-31de-458b-b5cb-e7e142ceea5a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:32.679256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:32.727636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:32.728186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:32.728462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:32.728734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] PATH_INFO: `/v3/projects/67cb2bfeeede49bda2c76ad71196324e` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:32.729859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cb2bfeeede49bda2c76ad71196324e)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:32.732096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:32.833392 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cb2bfeeede49bda2c76ad71196324e', 'request_id': 'req-cdd21f80-7b6c-46b0-934d-2d78044c23d3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.838667 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cb2bfeeede49bda2c76ad71196324e', 'request_id': 'req-cdd21f80-7b6c-46b0-934d-2d78044c23d3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.845188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cb2bfeeede49bda2c76ad71196324e', 'request_id': 'req-cdd21f80-7b6c-46b0-934d-2d78044c23d3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.889831 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] The token cache is being invalidate because project 67cb2bfeeede49bda2c76ad71196324e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:52:32.890109 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.890750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-cdd21f80-7b6c-46b0-934d-2d78044c23d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:52:32.892227 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1308/2603] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:52:32 2022] DELETE /identity/v3/projects/67cb2bfeeede49bda2c76ad71196324e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:32.897494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa47f2-7e9d-4d98-90be-0aead07e935f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:32.897781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa47f2-7e9d-4d98-90be-0aead07e935f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:32.898057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa47f2-7e9d-4d98-90be-0aead07e935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:32.917833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b4aa47f2-7e9d-4d98-90be-0aead07e935f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:32.919133 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b4aa47f2-7e9d-4d98-90be-0aead07e935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:32.978648 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1296/2604] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:32.987049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49a6d9-adde-49cd-8c2f-630af142c69d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:32.987328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49a6d9-adde-49cd-8c2f-630af142c69d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:32.987622 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49a6d9-adde-49cd-8c2f-630af142c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.006401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1e49a6d9-adde-49cd-8c2f-630af142c69d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:33.007619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1e49a6d9-adde-49cd-8c2f-630af142c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:33.015817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1309/2605] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:33.020305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa47f2-7e9d-4d98-90be-0aead07e935f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:33.033287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa47f2-7e9d-4d98-90be-0aead07e935f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:33.038290 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:33.038985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:33.039261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:33.039530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.040176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:52:33.040469 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:33.042056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:33.053405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1297/2606] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:52:33.057801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49a6d9-adde-49cd-8c2f-630af142c69d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:33.066786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49a6d9-adde-49cd-8c2f-630af142c69d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:33.071377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c417d-80b8-4c18-8254-8f996aa9dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:33.071953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c417d-80b8-4c18-8254-8f996aa9dc02 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:33.072225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c417d-80b8-4c18-8254-8f996aa9dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:33.072490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c417d-80b8-4c18-8254-8f996aa9dc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.073104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c417d-80b8-4c18-8254-8f996aa9dc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:33.075016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c417d-80b8-4c18-8254-8f996aa9dc02 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:33.154374 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1310/2607] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:52:33 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:33.159187 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:33.169152 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9660-94c0-4d90-8f57-b2beb4835438 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:33.224784 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5236-5daf-4439-8066-5b978b2c391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:33.225380 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5236-5daf-4439-8066-5b978b2c391c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:33.225654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5236-5daf-4439-8066-5b978b2c391c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:33.225922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5236-5daf-4439-8066-5b978b2c391c admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.226567 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5236-5daf-4439-8066-5b978b2c391c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:33.228452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5236-5daf-4439-8066-5b978b2c391c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:33.238996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:33.295751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1298/2608] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:52:33 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:52:33.299902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c417d-80b8-4c18-8254-8f996aa9dc02 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:33.310247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c417d-80b8-4c18-8254-8f996aa9dc02 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:33.315060 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4b1b3-221d-4d36-aa1d-9bfd5dae8836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:33.315646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4b1b3-221d-4d36-aa1d-9bfd5dae8836 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:33.315922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4b1b3-221d-4d36-aa1d-9bfd5dae8836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:33.316190 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4b1b3-221d-4d36-aa1d-9bfd5dae8836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.316823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4b1b3-221d-4d36-aa1d-9bfd5dae8836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:33.318488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4b1b3-221d-4d36-aa1d-9bfd5dae8836 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:33.328783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1311/2609] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:33.332770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5236-5daf-4439-8066-5b978b2c391c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:33.342287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5236-5daf-4439-8066-5b978b2c391c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:33.349537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17969d46-5327-4636-918a-1f3fa3d7c5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:33.350120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17969d46-5327-4636-918a-1f3fa3d7c5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:33.350392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17969d46-5327-4636-918a-1f3fa3d7c5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:33.350679 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17969d46-5327-4636-918a-1f3fa3d7c5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.354997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17969d46-5327-4636-918a-1f3fa3d7c5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:33.354997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17969d46-5327-4636-918a-1f3fa3d7c5f6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:33.363946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1299/2610] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:52:33.368220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4b1b3-221d-4d36-aa1d-9bfd5dae8836 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:33.378584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4b1b3-221d-4d36-aa1d-9bfd5dae8836 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:33.383180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:33.383817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:33.384095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:33.384367 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] PATH_INFO: `/v3/projects/ed5cde0a122f462ea2ba2888ffedf603/users/a9159dfe492c48dd88fb72785cbf36c7/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.399356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5cde0a122f462ea2ba2888ffedf603, user_id=a9159dfe492c48dd88fb72785cbf36c7, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:33.401986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:33.468171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1312/2611] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:52:33 2022] PUT /identity/v3/projects/ed5cde0a122f462ea2ba2888ffedf603/users/a9159dfe492c48dd88fb72785cbf36c7/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:52:33.478376 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66079-ddb1-4fbe-abc5-55c3b85bdf5d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:33.478690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66079-ddb1-4fbe-abc5-55c3b85bdf5d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:33.478961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66079-ddb1-4fbe-abc5-55c3b85bdf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.506675 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-50d66079-ddb1-4fbe-abc5-55c3b85bdf5d None None] MFA Rules not processed for user `a9159dfe492c48dd88fb72785cbf36c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:33.507788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-50d66079-ddb1-4fbe-abc5-55c3b85bdf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:33.573288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1300/2612] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:33.584008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:52:33.585680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:33.626431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:33.640649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a77430-2f05-4dbe-a3f5-0dd0848d81c2 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:52:33.644492 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfb2f8-056b-4ac8-82b1-6c1591bff2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:52:33.645076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfb2f8-056b-4ac8-82b1-6c1591bff2cd service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:33.645350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfb2f8-056b-4ac8-82b1-6c1591bff2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:33.645614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfb2f8-056b-4ac8-82b1-6c1591bff2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:33.654041 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfb2f8-056b-4ac8-82b1-6c1591bff2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:52:33.655992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfb2f8-056b-4ac8-82b1-6c1591bff2cd service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:52:33.664913 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1313/2613] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:52:36.589842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41e01-e15d-4fab-b184-8f5d736968fd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:52:36.590361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41e01-e15d-4fab-b184-8f5d736968fd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:52:36.590512 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41e01-e15d-4fab-b184-8f5d736968fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:52:36.609259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4fc41e01-e15d-4fab-b184-8f5d736968fd None None] MFA Rules not processed for user `a9159dfe492c48dd88fb72785cbf36c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:52:36.610515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4fc41e01-e15d-4fab-b184-8f5d736968fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:52:36.617331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1301/2614] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:52:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:52:43.713715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=9 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:46.604478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=42 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:00.448269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cbd86-ed09-4afd-a6fe-2a39c7053b43 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:00.448738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cbd86-ed09-4afd-a6fe-2a39c7053b43 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:00.448834 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cbd86-ed09-4afd-a6fe-2a39c7053b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:00.496092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ff9cbd86-ed09-4afd-a6fe-2a39c7053b43 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:00.497304 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ff9cbd86-ed09-4afd-a6fe-2a39c7053b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:00.559450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1314/2615] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:53:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:00.688114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc41e01-e15d-4fab-b184-8f5d736968fd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:00.689583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4fc41e01-e15d-4fab-b184-8f5d736968fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:00.779023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc41e01-e15d-4fab-b184-8f5d736968fd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:00.783984 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea87653-e283-45c6-bbdd-5ef36f9dbce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:00.784580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87653-e283-45c6-bbdd-5ef36f9dbce1 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:00.784852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87653-e283-45c6-bbdd-5ef36f9dbce1 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:00.785117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87653-e283-45c6-bbdd-5ef36f9dbce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:00.792900 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea87653-e283-45c6-bbdd-5ef36f9dbce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:00.794508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea87653-e283-45c6-bbdd-5ef36f9dbce1 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:00.802778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1302/2616] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:53:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:01.566166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feb45-b326-464f-8ff0-5f1600f4000f None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:01.566699 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feb45-b326-464f-8ff0-5f1600f4000f None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:01.566806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feb45-b326-464f-8ff0-5f1600f4000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:01.585692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-6b7feb45-b326-464f-8ff0-5f1600f4000f None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:01.586924 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6b7feb45-b326-464f-8ff0-5f1600f4000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:01.593987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1315/2617] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 10 08:53:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:01.606610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea87653-e283-45c6-bbdd-5ef36f9dbce1 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:01.617239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea87653-e283-45c6-bbdd-5ef36f9dbce1 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:01.622346 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3869-9e9b-4c98-9022-b1d137e55fc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:01.622970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3869-9e9b-4c98-9022-b1d137e55fc7 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:01.623259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3869-9e9b-4c98-9022-b1d137e55fc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:01.623550 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3869-9e9b-4c98-9022-b1d137e55fc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:01.631486 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3869-9e9b-4c98-9022-b1d137e55fc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:01.633059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3869-9e9b-4c98-9022-b1d137e55fc7 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:01.640985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1303/2618] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:53:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:02.135101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360397e8-3b5b-4b46-aa47-32fdfc2e2883 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:02.135386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360397e8-3b5b-4b46-aa47-32fdfc2e2883 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:02.135655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360397e8-3b5b-4b46-aa47-32fdfc2e2883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:02.154606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-360397e8-3b5b-4b46-aa47-32fdfc2e2883 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:02.155800 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-360397e8-3b5b-4b46-aa47-32fdfc2e2883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:02.163265 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1316/2619] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 10 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:02.175632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3869-9e9b-4c98-9022-b1d137e55fc7 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:02.186070 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3869-9e9b-4c98-9022-b1d137e55fc7 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:02.191888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bc433-0319-4ad1-8fc3-291ca83f6eca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:02.192478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bc433-0319-4ad1-8fc3-291ca83f6eca service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:02.192753 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bc433-0319-4ad1-8fc3-291ca83f6eca service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:02.193025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bc433-0319-4ad1-8fc3-291ca83f6eca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:02.200916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bc433-0319-4ad1-8fc3-291ca83f6eca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:02.202498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bc433-0319-4ad1-8fc3-291ca83f6eca service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:02.210431 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1304/2620] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:53:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:02.705282 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bdee-11f3-4490-b81c-f1bf03ea3cc9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:02.705754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bdee-11f3-4490-b81c-f1bf03ea3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:02.705854 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bdee-11f3-4490-b81c-f1bf03ea3cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:02.725935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-6dd8bdee-11f3-4490-b81c-f1bf03ea3cc9 None None] MFA Rules not processed for user `d79837cddc7b4e4dbf0dbe16d50fa0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:02.727145 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6dd8bdee-11f3-4490-b81c-f1bf03ea3cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:02.734102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1317/2621] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 10 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:02.746582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bc433-0319-4ad1-8fc3-291ca83f6eca service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:02.757003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bc433-0319-4ad1-8fc3-291ca83f6eca service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:02.762009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a015497-503d-4b4c-bfdd-3ca341bd2d6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3dd402dbe75410aa87c433cbde181c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:02.762622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a015497-503d-4b4c-bfdd-3ca341bd2d6c service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:02.762902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a015497-503d-4b4c-bfdd-3ca341bd2d6c service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:02.763170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a015497-503d-4b4c-bfdd-3ca341bd2d6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:02.771234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a015497-503d-4b4c-bfdd-3ca341bd2d6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:02.772828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a015497-503d-4b4c-bfdd-3ca341bd2d6c service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:02.780655 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1305/2622] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 10 08:53:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:05.976638 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8bdee-11f3-4490-b81c-f1bf03ea3cc9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:05.985875 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8bdee-11f3-4490-b81c-f1bf03ea3cc9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:05.991257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ff570-a1f7-437a-a1f1-100f910bee7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:05.991851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ff570-a1f7-437a-a1f1-100f910bee7c service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:05.992118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ff570-a1f7-437a-a1f1-100f910bee7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:05.992379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ff570-a1f7-437a-a1f1-100f910bee7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:05.994177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-731ff570-a1f7-437a-a1f1-100f910bee7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:06.076358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ff570-a1f7-437a-a1f1-100f910bee7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:06.077781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ff570-a1f7-437a-a1f1-100f910bee7c service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:06.096041 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1318/2623] 10.222.0.45 () {60 vars in 1396 bytes} [Wed Aug 10 08:53:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:53:07.528950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a015497-503d-4b4c-bfdd-3ca341bd2d6c service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:07.606522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a015497-503d-4b4c-bfdd-3ca341bd2d6c service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:07.611408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:07.612041 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:07.612317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:07.612587 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] PATH_INFO: `/v3/users/a9159dfe492c48dd88fb72785cbf36c7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:07.614367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9159dfe492c48dd88fb72785cbf36c7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:07.616369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:07.783945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:07.809823 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9159dfe492c48dd88fb72785cbf36c7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:07.867270 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9159dfe492c48dd88fb72785cbf36c7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:07.874765 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9159dfe492c48dd88fb72785cbf36c7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:07.886429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9159dfe492c48dd88fb72785cbf36c7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:07.887091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9159dfe492c48dd88fb72785cbf36c7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:07.893067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1306/2624] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:53:07 2022] DELETE /identity/v3/users/a9159dfe492c48dd88fb72785cbf36c7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:07.897672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460fe7a-057f-4221-99e3-fa3a06ecc0e8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:07.898188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460fe7a-057f-4221-99e3-fa3a06ecc0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:07.898291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460fe7a-057f-4221-99e3-fa3a06ecc0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:07.916994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a460fe7a-057f-4221-99e3-fa3a06ecc0e8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:07.923806 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a460fe7a-057f-4221-99e3-fa3a06ecc0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:07.935188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:07.975208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1319/2625] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:07.984952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:07.986350 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:08.043852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995f484-268e-431f-919d-ef45b7998780 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:08.047494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc815-a7a6-441e-9a54-75517dd3ffab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:08.052028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc815-a7a6-441e-9a54-75517dd3ffab service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:08.052028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc815-a7a6-441e-9a54-75517dd3ffab service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:08.052028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc815-a7a6-441e-9a54-75517dd3ffab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:08.058238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc815-a7a6-441e-9a54-75517dd3ffab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:08.059717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc815-a7a6-441e-9a54-75517dd3ffab service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:08.069113 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1307/2626] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:53:08.299097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460fe7a-057f-4221-99e3-fa3a06ecc0e8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:08.299097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a460fe7a-057f-4221-99e3-fa3a06ecc0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:08.311501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460fe7a-057f-4221-99e3-fa3a06ecc0e8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:08.316812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:08.317473 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:08.317748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:08.318016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] PATH_INFO: `/v3/projects/ed5cde0a122f462ea2ba2888ffedf603` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:08.319870 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5cde0a122f462ea2ba2888ffedf603)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:08.321888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:08.429010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5cde0a122f462ea2ba2888ffedf603', 'request_id': 'req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:08.434737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5cde0a122f462ea2ba2888ffedf603', 'request_id': 'req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:08.440949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5cde0a122f462ea2ba2888ffedf603', 'request_id': 'req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:08.546826 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] The token cache is being invalidate because project ed5cde0a122f462ea2ba2888ffedf603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:53:08.547119 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:08.547768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-52d2bb8d-0ca3-45ef-ac07-6db73775afdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:08.549377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1320/2627] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:53:08 2022] DELETE /identity/v3/projects/ed5cde0a122f462ea2ba2888ffedf603 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:08.554308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04460-20c5-4620-8c18-1d280ff82842 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:08.554830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04460-20c5-4620-8c18-1d280ff82842 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:08.554932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04460-20c5-4620-8c18-1d280ff82842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:08.602898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b3b04460-20c5-4620-8c18-1d280ff82842 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:08.604100 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b3b04460-20c5-4620-8c18-1d280ff82842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:08.666640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1308/2628] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:08.675228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298257-4c53-46b9-9ef8-62da0b688077 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:08.675408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298257-4c53-46b9-9ef8-62da0b688077 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:08.675680 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298257-4c53-46b9-9ef8-62da0b688077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:08.701922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-23298257-4c53-46b9-9ef8-62da0b688077 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:08.703158 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-23298257-4c53-46b9-9ef8-62da0b688077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:08.712134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1321/2629] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:08.716415 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04460-20c5-4620-8c18-1d280ff82842 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:08.726460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04460-20c5-4620-8c18-1d280ff82842 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:08.731186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:08.731881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:08.732158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:08.732425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:08.733065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:53:08.733361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:08.734979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:08.747942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1309/2630] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:53:08.752986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23298257-4c53-46b9-9ef8-62da0b688077 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:08.762754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23298257-4c53-46b9-9ef8-62da0b688077 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:08.767693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900569f9-d304-40d1-b33a-f1355fb2bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:08.768276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900569f9-d304-40d1-b33a-f1355fb2bfda admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:08.768550 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900569f9-d304-40d1-b33a-f1355fb2bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:08.768816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900569f9-d304-40d1-b33a-f1355fb2bfda admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:08.769435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900569f9-d304-40d1-b33a-f1355fb2bfda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:08.771975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900569f9-d304-40d1-b33a-f1355fb2bfda admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:08.881008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1322/2631] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:53:08 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:53:08.885092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:08.895503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aa24-127e-4c06-aecb-21500d009b37 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:08.934792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:08.953956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f44c-a4bf-48a8-837f-9c6372279359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:08.954593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f44c-a4bf-48a8-837f-9c6372279359 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:08.954871 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f44c-a4bf-48a8-837f-9c6372279359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:08.955239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f44c-a4bf-48a8-837f-9c6372279359 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:08.955884 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959f44c-a4bf-48a8-837f-9c6372279359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:08.957841 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959f44c-a4bf-48a8-837f-9c6372279359 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:09.066186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1310/2632] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:53:08 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:09.071248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900569f9-d304-40d1-b33a-f1355fb2bfda admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:09.081883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900569f9-d304-40d1-b33a-f1355fb2bfda admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:09.086357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bea71-e6cc-40cd-925d-43ba6ba097f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:09.086975 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bea71-e6cc-40cd-925d-43ba6ba097f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:09.087250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bea71-e6cc-40cd-925d-43ba6ba097f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:09.087516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bea71-e6cc-40cd-925d-43ba6ba097f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:09.088199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bea71-e6cc-40cd-925d-43ba6ba097f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:09.089765 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bea71-e6cc-40cd-925d-43ba6ba097f6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:09.099554 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1323/2633] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:09.103503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f44c-a4bf-48a8-837f-9c6372279359 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:09.113370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f44c-a4bf-48a8-837f-9c6372279359 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:09.118343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f4719-0287-4db1-bbba-c501d1c266c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:09.118959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f4719-0287-4db1-bbba-c501d1c266c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:09.119233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f4719-0287-4db1-bbba-c501d1c266c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:09.119499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f4719-0287-4db1-bbba-c501d1c266c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:09.120131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f4719-0287-4db1-bbba-c501d1c266c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:09.121741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f4719-0287-4db1-bbba-c501d1c266c9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:09.132001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1311/2634] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:09.135818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bea71-e6cc-40cd-925d-43ba6ba097f6 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:09.145945 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bea71-e6cc-40cd-925d-43ba6ba097f6 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:09.150644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:09.151318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:09.151596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:09.151893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] PATH_INFO: `/v3/projects/394abf084e6b43cab0764d51d8426a91/users/914859d3f6bf4c8fb7bf218fbc65e79c/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:09.166101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394abf084e6b43cab0764d51d8426a91, user_id=914859d3f6bf4c8fb7bf218fbc65e79c, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:09.168750 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:09.238318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1324/2635] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:53:09 2022] PUT /identity/v3/projects/394abf084e6b43cab0764d51d8426a91/users/914859d3f6bf4c8fb7bf218fbc65e79c/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:09.248995 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ae70b-f501-4a40-a18b-2b95091381bb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:09.249280 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ae70b-f501-4a40-a18b-2b95091381bb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:09.249549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ae70b-f501-4a40-a18b-2b95091381bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:09.276662 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-697ae70b-f501-4a40-a18b-2b95091381bb None None] MFA Rules not processed for user `914859d3f6bf4c8fb7bf218fbc65e79c`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:09.277855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-697ae70b-f501-4a40-a18b-2b95091381bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:09.341385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1312/2636] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:09.352654 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:09.354411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:09.401004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:09.412544 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923bd2-9ffa-430b-8041-85134a8100a0 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:09.416151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ed463-55b4-4114-a161-e42847b6aa63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:09.416740 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ed463-55b4-4114-a161-e42847b6aa63 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:09.417114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ed463-55b4-4114-a161-e42847b6aa63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:09.417293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ed463-55b4-4114-a161-e42847b6aa63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:09.425377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ed463-55b4-4114-a161-e42847b6aa63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:09.427451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ed463-55b4-4114-a161-e42847b6aa63 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:09.435970 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1325/2637] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:53:19.338602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:19.574962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=7 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:38.732972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ae70b-f501-4a40-a18b-2b95091381bb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:38.734373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-697ae70b-f501-4a40-a18b-2b95091381bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:38.799159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ae70b-f501-4a40-a18b-2b95091381bb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:38.804341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:38.804983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:38.805259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:38.805530 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] PATH_INFO: `/v3/users/1e26cd3e38254ac6aa4df360e5006519` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:38.806712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e26cd3e38254ac6aa4df360e5006519)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:38.808637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:39.062317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e26cd3e38254ac6aa4df360e5006519'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:39.164247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e26cd3e38254ac6aa4df360e5006519'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:39.171861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e26cd3e38254ac6aa4df360e5006519'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:39.185167 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e26cd3e38254ac6aa4df360e5006519'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:39.185890 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e26cd3e38254ac6aa4df360e5006519'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:39.191936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1313/2638] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:53:38 2022] DELETE /identity/v3/users/1e26cd3e38254ac6aa4df360e5006519 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:53:39.199154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430652-4a43-4d3e-b364-f570524becf3 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:39.199154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430652-4a43-4d3e-b364-f570524becf3 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:39.199154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430652-4a43-4d3e-b364-f570524becf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:39.216324 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-30430652-4a43-4d3e-b364-f570524becf3 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:39.217537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-30430652-4a43-4d3e-b364-f570524becf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:39.277296 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1326/2639] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:39.287639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:39.294657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:39.364490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cd549-09b1-435f-95e1-f3ff63e38381 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:39.368955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:39.369642 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:39.370181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:39.370549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:39.388680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:39.389909 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30430652-4a43-4d3e-b364-f570524becf3 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:39.390159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:39.392368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-30430652-4a43-4d3e-b364-f570524becf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:39.405276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1314/2640] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:53:39.498888 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30430652-4a43-4d3e-b364-f570524becf3 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:39.505689 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:39.506591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:39.506926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:39.507255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:39.509501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:39.525771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:39.528368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:39.544092 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1327/2641] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:53:40.041009 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:40.043046 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:40.063118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb46a6-bc5f-4ac9-ba03-7b7fc46e2389 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:40.069971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:40.071353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:40.071755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:40.072115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] PATH_INFO: `/v3/projects/74d1ff301f984303863d1c0bd0ddf9bf` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:40.073497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d1ff301f984303863d1c0bd0ddf9bf)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:40.075477 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:40.094520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:40.223252 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d1ff301f984303863d1c0bd0ddf9bf', 'request_id': 'req-4f24b909-c21d-423a-900a-e6eb8b4479fa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.329810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d1ff301f984303863d1c0bd0ddf9bf', 'request_id': 'req-4f24b909-c21d-423a-900a-e6eb8b4479fa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.337786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d1ff301f984303863d1c0bd0ddf9bf', 'request_id': 'req-4f24b909-c21d-423a-900a-e6eb8b4479fa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.349766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] The token cache is being invalidate because project 74d1ff301f984303863d1c0bd0ddf9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:53:40.350054 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.350741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.352325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1315/2642] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:53:40 2022] DELETE /identity/v3/projects/74d1ff301f984303863d1c0bd0ddf9bf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:40.356503 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:40.367269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587a896-edd9-4d8b-b76a-1aa9d5300f37 service nova] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:40.425250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:40.426320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:40.426640 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:40.426914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] PATH_INFO: `/v3/users/c2a7c8886c734f56895c1dde0189f401` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:40.428076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a7c8886c734f56895c1dde0189f401)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:40.429987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:40.553387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:40.622137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:40.625475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:40.636137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24b909-c21d-423a-900a-e6eb8b4479fa admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:40.641177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:40.642045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:40.642319 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:40.642710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] PATH_INFO: `/v3/users/914859d3f6bf4c8fb7bf218fbc65e79c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:40.644022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=914859d3f6bf4c8fb7bf218fbc65e79c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:40.646512 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:40.721154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a7c8886c734f56895c1dde0189f401'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.727918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a7c8886c734f56895c1dde0189f401'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.792640 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a7c8886c734f56895c1dde0189f401'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.793250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a7c8886c734f56895c1dde0189f401'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.808138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-875251aa-cbd4-4086-843a-75782469061c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a7c8886c734f56895c1dde0189f401'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.814807 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1328/2643] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:53:40 2022] DELETE /identity/v3/users/c2a7c8886c734f56895c1dde0189f401 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:40.857385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914859d3f6bf4c8fb7bf218fbc65e79c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.922429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914859d3f6bf4c8fb7bf218fbc65e79c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.930452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914859d3f6bf4c8fb7bf218fbc65e79c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.942531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914859d3f6bf4c8fb7bf218fbc65e79c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.943879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914859d3f6bf4c8fb7bf218fbc65e79c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:40.949721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1316/2644] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:53:40 2022] DELETE /identity/v3/users/914859d3f6bf4c8fb7bf218fbc65e79c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:53:40.954251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1d017-b46d-498f-81fd-41ae258184a5 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:40.954593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1d017-b46d-498f-81fd-41ae258184a5 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:40.958178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1d017-b46d-498f-81fd-41ae258184a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:40.974347 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-3fc1d017-b46d-498f-81fd-41ae258184a5 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:40.975665 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3fc1d017-b46d-498f-81fd-41ae258184a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:41.042481 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1329/2645] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:41.053484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:41.055002 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:41.114264 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac833b-db20-4beb-b38c-ea13808cc9bb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:41.118347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6ff47-a42d-4870-a0f4-5549d62fa657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:41.118987 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6ff47-a42d-4870-a0f4-5549d62fa657 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:41.119259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6ff47-a42d-4870-a0f4-5549d62fa657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:41.119523 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6ff47-a42d-4870-a0f4-5549d62fa657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:41.129398 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6ff47-a42d-4870-a0f4-5549d62fa657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:41.131029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6ff47-a42d-4870-a0f4-5549d62fa657 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:41.142489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1317/2646] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:53:41.449469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1d017-b46d-498f-81fd-41ae258184a5 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:41.451052 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3fc1d017-b46d-498f-81fd-41ae258184a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:41.476613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1d017-b46d-498f-81fd-41ae258184a5 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:41.476613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:41.476613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:41.477454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:41.477564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] PATH_INFO: `/v3/projects/3c12eeb3855d486cb2fb711e4e692956` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:41.479235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c12eeb3855d486cb2fb711e4e692956)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:41.480606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:41.604771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c12eeb3855d486cb2fb711e4e692956', 'request_id': 'req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:41.611625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c12eeb3855d486cb2fb711e4e692956', 'request_id': 'req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:41.619256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c12eeb3855d486cb2fb711e4e692956', 'request_id': 'req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:41.691188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] The token cache is being invalidate because project 3c12eeb3855d486cb2fb711e4e692956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:53:41.693547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:41.693547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:41.695180 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1330/2647] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:53:41 2022] DELETE /identity/v3/projects/3c12eeb3855d486cb2fb711e4e692956 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:41.700035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b519d-a902-4f67-8c93-a6d2e28d8e30 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:41.700568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b519d-a902-4f67-8c93-a6d2e28d8e30 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:41.700846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b519d-a902-4f67-8c93-a6d2e28d8e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:41.722453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-748b519d-a902-4f67-8c93-a6d2e28d8e30 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:41.724582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-748b519d-a902-4f67-8c93-a6d2e28d8e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:41.738535 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:41.784114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:41.785745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:41.797443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1318/2648] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:41.805150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d533b-22f4-4635-92ab-025e246d9b91 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:41.806402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d533b-22f4-4635-92ab-025e246d9b91 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:41.806876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d533b-22f4-4635-92ab-025e246d9b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:41.819114 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000fb08-ff91-4065-b9a4-e1c6d1fcbaea admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:41.822235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:41.822900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:41.823251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:41.823442 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] PATH_INFO: `/v3/projects/394abf084e6b43cab0764d51d8426a91` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:41.824583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394abf084e6b43cab0764d51d8426a91)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:41.826675 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:41.839416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ae5d533b-22f4-4635-92ab-025e246d9b91 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:41.840628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ae5d533b-22f4-4635-92ab-025e246d9b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:41.848769 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1319/2649] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:41.853590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d533b-22f4-4635-92ab-025e246d9b91 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:41.856634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:41.862782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d533b-22f4-4635-92ab-025e246d9b91 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:41.867417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:41.867996 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:41.868276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:41.868544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:41.869183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:53:41.869482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:41.871173 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:41.882546 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1320/2650] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:53:41.886693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:41.896909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de1e5-4d8b-4468-9115-c45afc225b57 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:41.901499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c1a3d-ba5b-449f-95d5-41654ed15633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:41.902057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1a3d-ba5b-449f-95d5-41654ed15633 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:41.902333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1a3d-ba5b-449f-95d5-41654ed15633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:41.902643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1a3d-ba5b-449f-95d5-41654ed15633 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:41.903244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c1a3d-ba5b-449f-95d5-41654ed15633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:41.905074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c1a3d-ba5b-449f-95d5-41654ed15633 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:41.933583 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394abf084e6b43cab0764d51d8426a91', 'request_id': 'req-b76b8711-b40b-474b-83d8-75cbaef6d892'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:41.946778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394abf084e6b43cab0764d51d8426a91', 'request_id': 'req-b76b8711-b40b-474b-83d8-75cbaef6d892'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:41.952555 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394abf084e6b43cab0764d51d8426a91', 'request_id': 'req-b76b8711-b40b-474b-83d8-75cbaef6d892'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:42.027298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] The token cache is being invalidate because project 394abf084e6b43cab0764d51d8426a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:53:42.035795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:42.035795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:42.035795 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1331/2651] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:53:41 2022] DELETE /identity/v3/projects/394abf084e6b43cab0764d51d8426a91 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:42.036427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1321/2652] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:53:41 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:53:42.049543 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:42.051127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:42.126871 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8711-b40b-474b-83d8-75cbaef6d892 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:42.188733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7f659-6cbe-42e9-862b-804bd7752583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:42.189549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7f659-6cbe-42e9-862b-804bd7752583 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.189922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7f659-6cbe-42e9-862b-804bd7752583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.191332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7f659-6cbe-42e9-862b-804bd7752583 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.191332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7f659-6cbe-42e9-862b-804bd7752583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:42.197896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7f659-6cbe-42e9-862b-804bd7752583 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:42.285225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1332/2653] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:53:42 2022] POST /identity/v3/users => generated 282 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:42.289749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c1a3d-ba5b-449f-95d5-41654ed15633 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:42.300625 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c1a3d-ba5b-449f-95d5-41654ed15633 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:42.305216 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e8eec-1009-4d01-8551-2c5e8c4e9a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:42.305876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e8eec-1009-4d01-8551-2c5e8c4e9a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.306575 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e8eec-1009-4d01-8551-2c5e8c4e9a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.310932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e8eec-1009-4d01-8551-2c5e8c4e9a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.310932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e8eec-1009-4d01-8551-2c5e8c4e9a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:42.310932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e8eec-1009-4d01-8551-2c5e8c4e9a44 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:42.320143 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1322/2654] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:42.324259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7f659-6cbe-42e9-862b-804bd7752583 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:42.334989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7f659-6cbe-42e9-862b-804bd7752583 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:42.345532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941436-8cfd-4914-b45a-a7319440aef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:42.345532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941436-8cfd-4914-b45a-a7319440aef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.345532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941436-8cfd-4914-b45a-a7319440aef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.345532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941436-8cfd-4914-b45a-a7319440aef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.345953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06941436-8cfd-4914-b45a-a7319440aef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:42.345953 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06941436-8cfd-4914-b45a-a7319440aef5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:42.352838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1333/2655] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:42.357261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e8eec-1009-4d01-8551-2c5e8c4e9a44 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:42.367412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e8eec-1009-4d01-8551-2c5e8c4e9a44 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:42.371940 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a1b71-b4bb-49d6-b716-c7cb22a3292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:42.374189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1b71-b4bb-49d6-b716-c7cb22a3292e admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.374189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1b71-b4bb-49d6-b716-c7cb22a3292e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.374189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1b71-b4bb-49d6-b716-c7cb22a3292e admin admin] PATH_INFO: `/v3/projects/f7645c065b4746418e45be2bb8758d17/users/c104a09a89da44ac84d927f8d26a0c0d/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.387985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a1b71-b4bb-49d6-b716-c7cb22a3292e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7645c065b4746418e45be2bb8758d17, user_id=c104a09a89da44ac84d927f8d26a0c0d, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:42.390639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a1b71-b4bb-49d6-b716-c7cb22a3292e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:42.461417 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1323/2656] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:53:42 2022] PUT /identity/v3/projects/f7645c065b4746418e45be2bb8758d17/users/c104a09a89da44ac84d927f8d26a0c0d/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:53:42.471607 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063872-c2f0-4ba6-b3ee-6a5d691c2356 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.472104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063872-c2f0-4ba6-b3ee-6a5d691c2356 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.472212 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063872-c2f0-4ba6-b3ee-6a5d691c2356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.498933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-24063872-c2f0-4ba6-b3ee-6a5d691c2356 None None] MFA Rules not processed for user `c104a09a89da44ac84d927f8d26a0c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:42.500134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-24063872-c2f0-4ba6-b3ee-6a5d691c2356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:42.564528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1334/2657] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:42.569715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a1b71-b4bb-49d6-b716-c7cb22a3292e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:42.609757 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:42.629312 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a1b71-b4bb-49d6-b716-c7cb22a3292e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:42.634694 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568540-f1d2-493e-802c-925431792278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:42.635286 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568540-f1d2-493e-802c-925431792278 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.635560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568540-f1d2-493e-802c-925431792278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.635824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568540-f1d2-493e-802c-925431792278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.636456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79568540-f1d2-493e-802c-925431792278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:42.638389 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79568540-f1d2-493e-802c-925431792278 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:42.725522 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1324/2658] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:53:42 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:42.729364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063872-c2f0-4ba6-b3ee-6a5d691c2356 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:42.741232 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063872-c2f0-4ba6-b3ee-6a5d691c2356 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:42.797729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c5c66-4983-4896-9842-bbd662bf1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:42.798315 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c5c66-4983-4896-9842-bbd662bf1e48 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.798796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c5c66-4983-4896-9842-bbd662bf1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.799065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c5c66-4983-4896-9842-bbd662bf1e48 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.799678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c5c66-4983-4896-9842-bbd662bf1e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:42.801569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c5c66-4983-4896-9842-bbd662bf1e48 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:42.867000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1335/2659] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:53:42 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:42.871151 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568540-f1d2-493e-802c-925431792278 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:42.882074 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568540-f1d2-493e-802c-925431792278 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:42.886757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891ff50-f80f-424f-a34f-b546abb6528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:42.887368 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ff50-f80f-424f-a34f-b546abb6528e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.887641 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ff50-f80f-424f-a34f-b546abb6528e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.887910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ff50-f80f-424f-a34f-b546abb6528e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.888649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891ff50-f80f-424f-a34f-b546abb6528e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:42.890231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891ff50-f80f-424f-a34f-b546abb6528e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:42.901295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1325/2660] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:42.905320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c5c66-4983-4896-9842-bbd662bf1e48 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:42.915779 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c5c66-4983-4896-9842-bbd662bf1e48 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:42.920410 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accdd53-7933-4c53-b071-37a0f409b955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:42.921078 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accdd53-7933-4c53-b071-37a0f409b955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:42.921373 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accdd53-7933-4c53-b071-37a0f409b955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:42.921677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accdd53-7933-4c53-b071-37a0f409b955 admin admin] PATH_INFO: `/v3/projects/76ed5abc1e2d403a9d193f90a2453b85/users/24e2d5ab4fa242b4adebbf8ea1639199/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:42.937177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accdd53-7933-4c53-b071-37a0f409b955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ed5abc1e2d403a9d193f90a2453b85, user_id=24e2d5ab4fa242b4adebbf8ea1639199, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:42.940006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accdd53-7933-4c53-b071-37a0f409b955 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:43.015940 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1336/2661] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:53:42 2022] PUT /identity/v3/projects/76ed5abc1e2d403a9d193f90a2453b85/users/24e2d5ab4fa242b4adebbf8ea1639199/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:43.020082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891ff50-f80f-424f-a34f-b546abb6528e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:43.030271 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891ff50-f80f-424f-a34f-b546abb6528e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:43.043108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:43.085791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78843490-ab05-4ff7-b5a1-2d823c80d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:43.086385 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843490-ab05-4ff7-b5a1-2d823c80d49e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:43.086692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843490-ab05-4ff7-b5a1-2d823c80d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:43.086968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843490-ab05-4ff7-b5a1-2d823c80d49e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:43.087600 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78843490-ab05-4ff7-b5a1-2d823c80d49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:43.089175 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78843490-ab05-4ff7-b5a1-2d823c80d49e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:43.098578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1326/2662] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:43.103260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accdd53-7933-4c53-b071-37a0f409b955 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:43.113460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accdd53-7933-4c53-b071-37a0f409b955 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:43.118778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:43.123521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:43.123521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:43.123521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] PATH_INFO: `/v3/projects/76ed5abc1e2d403a9d193f90a2453b85/users/24e2d5ab4fa242b4adebbf8ea1639199/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:43.123521 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ed5abc1e2d403a9d193f90a2453b85, user_id=24e2d5ab4fa242b4adebbf8ea1639199, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:43.124437 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:43.134415 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1337/2663] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:53:43 2022] PUT /identity/v3/projects/76ed5abc1e2d403a9d193f90a2453b85/users/24e2d5ab4fa242b4adebbf8ea1639199/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:53:43.145441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7aa86-b5ab-44e6-9c10-95b75768028f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:43.145727 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7aa86-b5ab-44e6-9c10-95b75768028f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:43.146179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7aa86-b5ab-44e6-9c10-95b75768028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:43.173390 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b7e7aa86-b5ab-44e6-9c10-95b75768028f None None] MFA Rules not processed for user `24e2d5ab4fa242b4adebbf8ea1639199`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:43.175096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b7e7aa86-b5ab-44e6-9c10-95b75768028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:43.242013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1327/2664] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:43.253327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:43.255113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:43.314140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2f560-144b-4822-8caf-b2e74ffd4558 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:43.320652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca7265-84fa-4d3c-8dfa-2386782792e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:43.320652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7265-84fa-4d3c-8dfa-2386782792e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:43.320652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7265-84fa-4d3c-8dfa-2386782792e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:43.320652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7265-84fa-4d3c-8dfa-2386782792e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:43.329363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca7265-84fa-4d3c-8dfa-2386782792e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:43.330941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca7265-84fa-4d3c-8dfa-2386782792e2 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:43.341045 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1338/2665] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:53:44.426637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7aa86-b5ab-44e6-9c10-95b75768028f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:44.487516 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7aa86-b5ab-44e6-9c10-95b75768028f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:44.492713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:44.493334 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:44.493608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:44.493881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] PATH_INFO: `/v3/users/c104a09a89da44ac84d927f8d26a0c0d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:44.495037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c104a09a89da44ac84d927f8d26a0c0d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:44.496934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:44.721671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:44.727094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c104a09a89da44ac84d927f8d26a0c0d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:44.796551 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c104a09a89da44ac84d927f8d26a0c0d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:44.804114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c104a09a89da44ac84d927f8d26a0c0d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:44.822611 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c104a09a89da44ac84d927f8d26a0c0d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:44.823338 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c104a09a89da44ac84d927f8d26a0c0d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:44.829521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1328/2666] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:53:44 2022] DELETE /identity/v3/users/c104a09a89da44ac84d927f8d26a0c0d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:44.834121 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0778c9-0de5-4f5a-a422-f252f419e20c None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:44.835239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0778c9-0de5-4f5a-a422-f252f419e20c None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:44.835239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0778c9-0de5-4f5a-a422-f252f419e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:44.857959 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9b0778c9-0de5-4f5a-a422-f252f419e20c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:44.859225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9b0778c9-0de5-4f5a-a422-f252f419e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:44.876643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:44.918769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1339/2667] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:44.928716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:44.930154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:44.988637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a4cc9-784d-4a73-a873-b99d579d2e5b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:44.992314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e6ac7-3ad9-4001-86fd-df99112cf356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:44.997225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e6ac7-3ad9-4001-86fd-df99112cf356 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:44.997225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e6ac7-3ad9-4001-86fd-df99112cf356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:44.997225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e6ac7-3ad9-4001-86fd-df99112cf356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:45.002190 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e6ac7-3ad9-4001-86fd-df99112cf356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:45.003686 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e6ac7-3ad9-4001-86fd-df99112cf356 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:45.013056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1329/2668] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:53:45.422446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0778c9-0de5-4f5a-a422-f252f419e20c None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:45.423881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9b0778c9-0de5-4f5a-a422-f252f419e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:45.437336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0778c9-0de5-4f5a-a422-f252f419e20c None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:45.441912 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:45.443231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:45.443515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:45.443922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] PATH_INFO: `/v3/projects/f7645c065b4746418e45be2bb8758d17` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:45.445562 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7645c065b4746418e45be2bb8758d17)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:45.447522 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:45.559242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7645c065b4746418e45be2bb8758d17', 'request_id': 'req-99e90d9e-1676-4532-90d4-2e0ed89df302'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.564506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7645c065b4746418e45be2bb8758d17', 'request_id': 'req-99e90d9e-1676-4532-90d4-2e0ed89df302'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.571187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7645c065b4746418e45be2bb8758d17', 'request_id': 'req-99e90d9e-1676-4532-90d4-2e0ed89df302'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.647744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] The token cache is being invalidate because project f7645c065b4746418e45be2bb8758d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:53:45.648026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.648639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.650201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1340/2669] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:53:45 2022] DELETE /identity/v3/projects/f7645c065b4746418e45be2bb8758d17 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:45.654332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e6ac7-3ad9-4001-86fd-df99112cf356 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:45.664089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e6ac7-3ad9-4001-86fd-df99112cf356 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:45.720384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:45.721003 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:45.721276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:45.721542 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] PATH_INFO: `/v3/users/24e2d5ab4fa242b4adebbf8ea1639199` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:45.722740 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e2d5ab4fa242b4adebbf8ea1639199)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:45.724640 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:45.890071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e2d5ab4fa242b4adebbf8ea1639199'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.952339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e2d5ab4fa242b4adebbf8ea1639199'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.959833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e2d5ab4fa242b4adebbf8ea1639199'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.960946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:45.972295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e2d5ab4fa242b4adebbf8ea1639199'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.972944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e2d5ab4fa242b4adebbf8ea1639199'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:45.979337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1330/2670] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:53:45 2022] DELETE /identity/v3/users/24e2d5ab4fa242b4adebbf8ea1639199 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:46.215483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:46.217007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:46.274136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e90d9e-1676-4532-90d4-2e0ed89df302 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:46.321260 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df8a35-04db-45b9-a358-e56c1ff2c360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:46.321791 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8a35-04db-45b9-a358-e56c1ff2c360 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:46.322067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8a35-04db-45b9-a358-e56c1ff2c360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:46.322333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8a35-04db-45b9-a358-e56c1ff2c360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:46.324110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-79df8a35-04db-45b9-a358-e56c1ff2c360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:46.337835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:46.386385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df8a35-04db-45b9-a358-e56c1ff2c360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:46.387871 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df8a35-04db-45b9-a358-e56c1ff2c360 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:46.393108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:46.395253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:46.402340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1341/2671] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:53:46.416528 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd03e-b9b8-485b-b626-2075fcaf4e16 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:46.426817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:46.437341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:46.437341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:46.437341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] PATH_INFO: `/v3/projects/76ed5abc1e2d403a9d193f90a2453b85` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:46.437341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ed5abc1e2d403a9d193f90a2453b85)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:46.437341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:46.576258 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ed5abc1e2d403a9d193f90a2453b85', 'request_id': 'req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:46.678519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ed5abc1e2d403a9d193f90a2453b85', 'request_id': 'req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:46.686032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ed5abc1e2d403a9d193f90a2453b85', 'request_id': 'req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:46.697232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] The token cache is being invalidate because project 76ed5abc1e2d403a9d193f90a2453b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:53:46.697515 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:46.698239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77ee38bd-7c37-49f8-bab2-c6eb352d4e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:46.699829 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1331/2672] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:53:46 2022] DELETE /identity/v3/projects/76ed5abc1e2d403a9d193f90a2453b85 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:46.704944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799794d-67c1-4c51-8bb1-07144fac83d9 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:46.705257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799794d-67c1-4c51-8bb1-07144fac83d9 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:46.705531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799794d-67c1-4c51-8bb1-07144fac83d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:46.725496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8799794d-67c1-4c51-8bb1-07144fac83d9 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:46.726829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8799794d-67c1-4c51-8bb1-07144fac83d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:46.786787 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1342/2673] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:46.794352 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e262134-26b0-4fc5-9e84-4fccae4f3100 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:46.794766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e262134-26b0-4fc5-9e84-4fccae4f3100 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:46.799817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e262134-26b0-4fc5-9e84-4fccae4f3100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:46.815161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6e262134-26b0-4fc5-9e84-4fccae4f3100 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:46.816511 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6e262134-26b0-4fc5-9e84-4fccae4f3100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:46.825265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1332/2674] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:46.829649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799794d-67c1-4c51-8bb1-07144fac83d9 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:46.843297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799794d-67c1-4c51-8bb1-07144fac83d9 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:46.849351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:46.849351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:46.849351 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:46.849937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:46.850674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:53:46.850984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:46.852599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:46.866968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1343/2675] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:53:46.871365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e262134-26b0-4fc5-9e84-4fccae4f3100 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:46.880708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e262134-26b0-4fc5-9e84-4fccae4f3100 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:46.886082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437edd04-489a-4654-b722-ce980686c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:46.886703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edd04-489a-4654-b722-ce980686c613 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:46.886978 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edd04-489a-4654-b722-ce980686c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:46.887245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edd04-489a-4654-b722-ce980686c613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:46.887868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437edd04-489a-4654-b722-ce980686c613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:46.889747 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437edd04-489a-4654-b722-ce980686c613 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:46.975631 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1333/2676] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:53:46 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:46.979758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:46.989718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f804053-1dc2-49f8-bbb6-97b6067db873 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:47.047577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2678f-0bf5-48ea-902f-41dd03d0df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:47.048182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2678f-0bf5-48ea-902f-41dd03d0df82 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.048454 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2678f-0bf5-48ea-902f-41dd03d0df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.048720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2678f-0bf5-48ea-902f-41dd03d0df82 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.049341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2678f-0bf5-48ea-902f-41dd03d0df82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:47.051289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2678f-0bf5-48ea-902f-41dd03d0df82 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:47.128589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1344/2677] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:53:46 2022] POST /identity/v3/users => generated 278 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:53:47.132993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437edd04-489a-4654-b722-ce980686c613 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:47.143894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437edd04-489a-4654-b722-ce980686c613 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:47.149479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58494558-70c3-4185-9afb-d8f82908f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:47.150065 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58494558-70c3-4185-9afb-d8f82908f5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.150336 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58494558-70c3-4185-9afb-d8f82908f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.151091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58494558-70c3-4185-9afb-d8f82908f5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.151301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58494558-70c3-4185-9afb-d8f82908f5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:47.152905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58494558-70c3-4185-9afb-d8f82908f5c6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:47.164169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1334/2678] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:47.169115 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2678f-0bf5-48ea-902f-41dd03d0df82 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:47.180365 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2678f-0bf5-48ea-902f-41dd03d0df82 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:47.184998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdabdd-1dd0-4371-a8d1-00cbe7db6789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:47.185585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdabdd-1dd0-4371-a8d1-00cbe7db6789 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.185859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdabdd-1dd0-4371-a8d1-00cbe7db6789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.186122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdabdd-1dd0-4371-a8d1-00cbe7db6789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.186792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdabdd-1dd0-4371-a8d1-00cbe7db6789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:47.188350 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdabdd-1dd0-4371-a8d1-00cbe7db6789 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:47.202979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1345/2679] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:47.204538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58494558-70c3-4185-9afb-d8f82908f5c6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:47.214571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58494558-70c3-4185-9afb-d8f82908f5c6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:47.219246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d0f8-242e-4155-bbd9-4990637a4c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:47.219899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d0f8-242e-4155-bbd9-4990637a4c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.220176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d0f8-242e-4155-bbd9-4990637a4c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.220446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d0f8-242e-4155-bbd9-4990637a4c32 admin admin] PATH_INFO: `/v3/projects/f6f9815f49234eda8aae568484b912be/users/6bc3e8d2b64149d28b5372bf0b1abdc7/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.235220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02d0f8-242e-4155-bbd9-4990637a4c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f9815f49234eda8aae568484b912be, user_id=6bc3e8d2b64149d28b5372bf0b1abdc7, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:47.237974 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02d0f8-242e-4155-bbd9-4990637a4c32 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:47.324661 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1335/2680] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:53:47 2022] PUT /identity/v3/projects/f6f9815f49234eda8aae568484b912be/users/6bc3e8d2b64149d28b5372bf0b1abdc7/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:47.331479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f521-7e8b-4e26-a25f-b687ccfdebbb None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.331996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f521-7e8b-4e26-a25f-b687ccfdebbb None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.332591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f521-7e8b-4e26-a25f-b687ccfdebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.372322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7585f521-7e8b-4e26-a25f-b687ccfdebbb None None] MFA Rules not processed for user `6bc3e8d2b64149d28b5372bf0b1abdc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:47.374716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7585f521-7e8b-4e26-a25f-b687ccfdebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:47.382509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:47.465220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1346/2681] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:47.469649 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d0f8-242e-4155-bbd9-4990637a4c32 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:47.549971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d0f8-242e-4155-bbd9-4990637a4c32 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:47.555018 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080c6d-0a4c-4870-87d1-87a804ffa034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:47.555749 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080c6d-0a4c-4870-87d1-87a804ffa034 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.556092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080c6d-0a4c-4870-87d1-87a804ffa034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.556427 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080c6d-0a4c-4870-87d1-87a804ffa034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.557596 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89080c6d-0a4c-4870-87d1-87a804ffa034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:47.559656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89080c6d-0a4c-4870-87d1-87a804ffa034 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:47.565473 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:47.666579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1336/2682] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:53:47 2022] POST /identity/v3/projects => generated 357 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:47.668116 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585f521-7e8b-4e26-a25f-b687ccfdebbb None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:47.682148 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585f521-7e8b-4e26-a25f-b687ccfdebbb None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:47.755931 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d2d70-e50a-4f13-9729-c8b3e4e65135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:47.758139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2d70-e50a-4f13-9729-c8b3e4e65135 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.758139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2d70-e50a-4f13-9729-c8b3e4e65135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.758139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2d70-e50a-4f13-9729-c8b3e4e65135 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.758605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d2d70-e50a-4f13-9729-c8b3e4e65135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:47.760580 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d2d70-e50a-4f13-9729-c8b3e4e65135 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:47.836008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1347/2683] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:53:47 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:47.842228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080c6d-0a4c-4870-87d1-87a804ffa034 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:47.855192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080c6d-0a4c-4870-87d1-87a804ffa034 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:47.867483 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4167306-3d49-4abe-bf90-abb8ecf869d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:47.875237 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4167306-3d49-4abe-bf90-abb8ecf869d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.875521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4167306-3d49-4abe-bf90-abb8ecf869d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.877012 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4167306-3d49-4abe-bf90-abb8ecf869d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.878565 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4167306-3d49-4abe-bf90-abb8ecf869d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:47.890214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4167306-3d49-4abe-bf90-abb8ecf869d9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:47.899850 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1337/2684] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:47.904053 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d2d70-e50a-4f13-9729-c8b3e4e65135 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:47.921196 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d2d70-e50a-4f13-9729-c8b3e4e65135 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:47.935843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e22cda-f014-4bef-be8c-bc4aedbe4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:47.937405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e22cda-f014-4bef-be8c-bc4aedbe4bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:47.937405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e22cda-f014-4bef-be8c-bc4aedbe4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:47.937405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e22cda-f014-4bef-be8c-bc4aedbe4bcc admin admin] PATH_INFO: `/v3/projects/40fcd0945bdc48fda2792cbd177fb0d0/users/9241a62d970e441a8131e8469d90ae04/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:47.959027 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e22cda-f014-4bef-be8c-bc4aedbe4bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fcd0945bdc48fda2792cbd177fb0d0, user_id=9241a62d970e441a8131e8469d90ae04, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:47.961776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e22cda-f014-4bef-be8c-bc4aedbe4bcc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:48.011456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1348/2685] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:53:47 2022] PUT /identity/v3/projects/40fcd0945bdc48fda2792cbd177fb0d0/users/9241a62d970e441a8131e8469d90ae04/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:48.015521 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4167306-3d49-4abe-bf90-abb8ecf869d9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:48.027108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4167306-3d49-4abe-bf90-abb8ecf869d9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:48.096724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7dd14-f50d-4c1e-a9e8-7a7b7b58317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:48.097657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7dd14-f50d-4c1e-a9e8-7a7b7b58317d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:48.098278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7dd14-f50d-4c1e-a9e8-7a7b7b58317d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:48.098735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7dd14-f50d-4c1e-a9e8-7a7b7b58317d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:48.099584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7dd14-f50d-4c1e-a9e8-7a7b7b58317d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:48.102760 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7dd14-f50d-4c1e-a9e8-7a7b7b58317d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:48.115800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1338/2686] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:53:48.121117 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e22cda-f014-4bef-be8c-bc4aedbe4bcc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:48.135033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e22cda-f014-4bef-be8c-bc4aedbe4bcc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:48.143427 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:48.144193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:48.144547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:48.144894 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] PATH_INFO: `/v3/projects/40fcd0945bdc48fda2792cbd177fb0d0/users/9241a62d970e441a8131e8469d90ae04/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:48.147102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fcd0945bdc48fda2792cbd177fb0d0, user_id=9241a62d970e441a8131e8469d90ae04, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:48.149994 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:48.162501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1349/2687] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:53:48 2022] PUT /identity/v3/projects/40fcd0945bdc48fda2792cbd177fb0d0/users/9241a62d970e441a8131e8469d90ae04/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:48.174885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3d31-38dc-4ccb-b3a6-677dddea0bd6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:48.175208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3d31-38dc-4ccb-b3a6-677dddea0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:48.175451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3d31-38dc-4ccb-b3a6-677dddea0bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:48.208248 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b15c3d31-38dc-4ccb-b3a6-677dddea0bd6 None None] MFA Rules not processed for user `9241a62d970e441a8131e8469d90ae04`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:48.209603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b15c3d31-38dc-4ccb-b3a6-677dddea0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:48.287644 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1339/2688] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:53:48.299767 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:48.301838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:48.367383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce43f-e0b9-4b1c-a037-38476fd08c89 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:48.372516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:48.375841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:48.375841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:48.375841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:48.386918 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:48.388483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:48.398958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1350/2689] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:53:48.607083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c3d31-38dc-4ccb-b3a6-677dddea0bd6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:48.621538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c3d31-38dc-4ccb-b3a6-677dddea0bd6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:48.625249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:48.625865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:48.626214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:48.626531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:48.688741 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:48.693425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:48.695734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:48.705178 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1340/2690] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:53:50.079023 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:50.080836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:50.090068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:50.164673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceac06-525f-4d46-8056-cbbaba3235c8 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:50.184017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:50.184017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:50.184017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:50.184017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:50.185790 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:50.189776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:50.191394 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:50.203031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1351/2691] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:53:50.252658 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:50.254172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:50.324519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79d706-7c54-48bd-999d-9218b556ef87 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:50.329220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:50.329849 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:50.330150 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:50.330426 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] PATH_INFO: `/v3/users/4542138b7aa5446b8544dc766cbcb372` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:50.331620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4542138b7aa5446b8544dc766cbcb372)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:50.333527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:50.531121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4542138b7aa5446b8544dc766cbcb372'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:50.619589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4542138b7aa5446b8544dc766cbcb372'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:50.629107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4542138b7aa5446b8544dc766cbcb372'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:50.642083 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4542138b7aa5446b8544dc766cbcb372'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:50.642786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0921100c-001d-4590-bb16-1e096c009869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4542138b7aa5446b8544dc766cbcb372'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:50.648773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1341/2692] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:53:50 2022] DELETE /identity/v3/users/4542138b7aa5446b8544dc766cbcb372 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:50.908236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:50.918810 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff5020-81c5-4a57-b0ee-7d805fd9b7a2 service placement] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:50.980395 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:50.981016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:50.981291 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:50.981560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] PATH_INFO: `/v3/projects/934ce9d029694762938d6a2264fad07d` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:50.982686 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934ce9d029694762938d6a2264fad07d)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:50.984573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:51.077022 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934ce9d029694762938d6a2264fad07d', 'request_id': 'req-377dfd5a-8077-4381-afc3-fc96b4689a98'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:51.082432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934ce9d029694762938d6a2264fad07d', 'request_id': 'req-377dfd5a-8077-4381-afc3-fc96b4689a98'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:51.088458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934ce9d029694762938d6a2264fad07d', 'request_id': 'req-377dfd5a-8077-4381-afc3-fc96b4689a98'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:51.160609 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] The token cache is being invalidate because project 934ce9d029694762938d6a2264fad07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:53:51.160893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:51.161539 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-377dfd5a-8077-4381-afc3-fc96b4689a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:53:51.163532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1352/2693] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:53:50 2022] DELETE /identity/v3/projects/934ce9d029694762938d6a2264fad07d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:51.168479 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64396-8d7f-4915-a070-dbe84ba4e0bf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.168768 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64396-8d7f-4915-a070-dbe84ba4e0bf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.169045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64396-8d7f-4915-a070-dbe84ba4e0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.189033 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b5e64396-8d7f-4915-a070-dbe84ba4e0bf None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:51.190298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b5e64396-8d7f-4915-a070-dbe84ba4e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:51.247443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1342/2694] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:51.255055 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd515-9c72-4830-8436-3f19ab922eb8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.255340 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd515-9c72-4830-8436-3f19ab922eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.255613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd515-9c72-4830-8436-3f19ab922eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.274949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-a9ebd515-9c72-4830-8436-3f19ab922eb8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:51.276150 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a9ebd515-9c72-4830-8436-3f19ab922eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:51.284011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1353/2695] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:51.288502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e64396-8d7f-4915-a070-dbe84ba4e0bf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:51.297907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e64396-8d7f-4915-a070-dbe84ba4e0bf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:51.302402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:51.303029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.303305 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.303572 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.304801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:53:51.305098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:51.306704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:51.315410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:51.318597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1343/2696] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:53:51.322724 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd515-9c72-4830-8436-3f19ab922eb8 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:51.331824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd515-9c72-4830-8436-3f19ab922eb8 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:51.336428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f08c3-a609-4f63-8539-6f153bf0be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:51.337009 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f08c3-a609-4f63-8539-6f153bf0be85 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.337284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f08c3-a609-4f63-8539-6f153bf0be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.344275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f08c3-a609-4f63-8539-6f153bf0be85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.344275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f08c3-a609-4f63-8539-6f153bf0be85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:51.344275 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f08c3-a609-4f63-8539-6f153bf0be85 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:51.355926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:51.422230 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1354/2697] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:53:51 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:51.426094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:51.436547 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1dd0c-6362-4cb9-a67c-d5c3427b7bcd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:51.491795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b960e4-f3a1-46b6-8d2c-6e235a9b7b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:51.492391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b960e4-f3a1-46b6-8d2c-6e235a9b7b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.492696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b960e4-f3a1-46b6-8d2c-6e235a9b7b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.492997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b960e4-f3a1-46b6-8d2c-6e235a9b7b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.493643 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b960e4-f3a1-46b6-8d2c-6e235a9b7b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:51.495589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b960e4-f3a1-46b6-8d2c-6e235a9b7b98 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:51.593059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1344/2698] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:53:51 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:53:51.599497 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f08c3-a609-4f63-8539-6f153bf0be85 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:51.610728 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f08c3-a609-4f63-8539-6f153bf0be85 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:51.615776 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e703187-cda6-4f65-add8-1710b9f2f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:51.616452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e703187-cda6-4f65-add8-1710b9f2f60b admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.621631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e703187-cda6-4f65-add8-1710b9f2f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.621631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e703187-cda6-4f65-add8-1710b9f2f60b admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.621631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e703187-cda6-4f65-add8-1710b9f2f60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:51.621631 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e703187-cda6-4f65-add8-1710b9f2f60b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:51.629472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1355/2699] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:53:51.633628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b960e4-f3a1-46b6-8d2c-6e235a9b7b98 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:51.643925 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b960e4-f3a1-46b6-8d2c-6e235a9b7b98 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:51.649069 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8f419-d4b5-4e82-872e-f23f4deda392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:51.650410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f419-d4b5-4e82-872e-f23f4deda392 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.650410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f419-d4b5-4e82-872e-f23f4deda392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.650410 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f419-d4b5-4e82-872e-f23f4deda392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.650913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8f419-d4b5-4e82-872e-f23f4deda392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:51.652497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8f419-d4b5-4e82-872e-f23f4deda392 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:51.662812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1345/2700] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:53:51.667573 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e703187-cda6-4f65-add8-1710b9f2f60b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:51.677549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e703187-cda6-4f65-add8-1710b9f2f60b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:51.682586 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:51.683273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.683552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.683824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] PATH_INFO: `/v3/projects/e66a9995d44a4efaa817382daea43df5/users/c60f3403b7644561986335fa448d384e/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.699171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66a9995d44a4efaa817382daea43df5, user_id=c60f3403b7644561986335fa448d384e, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:51.701817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:51.793123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1356/2701] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:53:51 2022] PUT /identity/v3/projects/e66a9995d44a4efaa817382daea43df5/users/c60f3403b7644561986335fa448d384e/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:53:51.804495 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b05c-ebb1-4f04-ba57-29d641220ede None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.804778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b05c-ebb1-4f04-ba57-29d641220ede None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.805055 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b05c-ebb1-4f04-ba57-29d641220ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:51.843063 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a7d5b05c-ebb1-4f04-ba57-29d641220ede None None] MFA Rules not processed for user `c60f3403b7644561986335fa448d384e`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:53:51.843063 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a7d5b05c-ebb1-4f04-ba57-29d641220ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:51.900553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1346/2702] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:53:51.911730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:53:51.913438 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:53:51.987677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a90d5-28ce-4935-b647-e206a9aca427 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:53:51.993295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2b45a-bf04-4127-87b1-bbcaa51537f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:53:51.993879 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2b45a-bf04-4127-87b1-bbcaa51537f9 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:53:51.994153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2b45a-bf04-4127-87b1-bbcaa51537f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:53:51.994421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2b45a-bf04-4127-87b1-bbcaa51537f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:53:52.001979 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2b45a-bf04-4127-87b1-bbcaa51537f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:53:52.003581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2b45a-bf04-4127-87b1-bbcaa51537f9 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:53:52.012721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1357/2703] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:53:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:01.897010 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:02.008818 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:INSERT=2,keystone:SELECT=51 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:03.337708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5b05c-ebb1-4f04-ba57-29d641220ede None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:03.397416 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5b05c-ebb1-4f04-ba57-29d641220ede None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:03.401897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:03.402568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:03.402846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:03.403115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] PATH_INFO: `/v3/users/c60f3403b7644561986335fa448d384e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:03.404219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60f3403b7644561986335fa448d384e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:03.406116 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:03.571246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60f3403b7644561986335fa448d384e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:03.666403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60f3403b7644561986335fa448d384e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:03.673460 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60f3403b7644561986335fa448d384e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:03.684958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60f3403b7644561986335fa448d384e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:03.685594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60f3403b7644561986335fa448d384e'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:03.691412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1347/2704] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:03 2022] DELETE /identity/v3/users/c60f3403b7644561986335fa448d384e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:03.695855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429924fd-c864-4df2-9973-575cf024aa94 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:03.696366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429924fd-c864-4df2-9973-575cf024aa94 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:03.696485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429924fd-c864-4df2-9973-575cf024aa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:03.715219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-429924fd-c864-4df2-9973-575cf024aa94 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:03.716411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-429924fd-c864-4df2-9973-575cf024aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:03.778032 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1358/2705] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:03.787928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:03.789980 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:03.847833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa1068-03d2-4555-a710-f53123220b86 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:03.851520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c7192-09ec-4a2a-ae8f-2e0e4e558c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:03.852126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c7192-09ec-4a2a-ae8f-2e0e4e558c58 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:03.852403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c7192-09ec-4a2a-ae8f-2e0e4e558c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:03.852766 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c7192-09ec-4a2a-ae8f-2e0e4e558c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:03.862016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c7192-09ec-4a2a-ae8f-2e0e4e558c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:03.863484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c7192-09ec-4a2a-ae8f-2e0e4e558c58 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:03.873455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1348/2706] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:04.290933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429924fd-c864-4df2-9973-575cf024aa94 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:04.292359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-429924fd-c864-4df2-9973-575cf024aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:04.305601 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429924fd-c864-4df2-9973-575cf024aa94 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:04.310257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:04.310941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:04.311207 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:04.311477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] PATH_INFO: `/v3/projects/e66a9995d44a4efaa817382daea43df5` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:04.313404 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66a9995d44a4efaa817382daea43df5)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:04.319379 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:04.444071 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66a9995d44a4efaa817382daea43df5', 'request_id': 'req-caf68b79-188d-4180-8dc9-dca716e19137'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:04.450139 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66a9995d44a4efaa817382daea43df5', 'request_id': 'req-caf68b79-188d-4180-8dc9-dca716e19137'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:04.456510 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66a9995d44a4efaa817382daea43df5', 'request_id': 'req-caf68b79-188d-4180-8dc9-dca716e19137'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:04.522580 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] The token cache is being invalidate because project e66a9995d44a4efaa817382daea43df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:04.522859 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:04.523483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-caf68b79-188d-4180-8dc9-dca716e19137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:04.524935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1359/2707] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:04 2022] DELETE /identity/v3/projects/e66a9995d44a4efaa817382daea43df5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:04.529828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33911-bd0d-4e2b-b011-5cfe0cb6b86a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:04.530536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33911-bd0d-4e2b-b011-5cfe0cb6b86a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:04.530536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33911-bd0d-4e2b-b011-5cfe0cb6b86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:04.551236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-85e33911-bd0d-4e2b-b011-5cfe0cb6b86a None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:04.551404 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-85e33911-bd0d-4e2b-b011-5cfe0cb6b86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:04.571038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:04.613052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1349/2708] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:04.627504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10ec9-8227-466a-9266-431df600cf19 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:04.627504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10ec9-8227-466a-9266-431df600cf19 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:04.627504 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10ec9-8227-466a-9266-431df600cf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:04.647272 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-c8b10ec9-8227-466a-9266-431df600cf19 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:04.648501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-c8b10ec9-8227-466a-9266-431df600cf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:04.656768 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1360/2709] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:54:04.660838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e33911-bd0d-4e2b-b011-5cfe0cb6b86a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:04.672584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e33911-bd0d-4e2b-b011-5cfe0cb6b86a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:04.677737 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:04.678347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:04.678657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:04.678927 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:04.680310 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:54:04.680712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:04.682192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:04.694419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1350/2710] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:54:04.698549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10ec9-8227-466a-9266-431df600cf19 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:04.708188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10ec9-8227-466a-9266-431df600cf19 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:04.713188 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9187f-3055-492b-bb7c-df605359f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:04.713977 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9187f-3055-492b-bb7c-df605359f5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:04.714254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9187f-3055-492b-bb7c-df605359f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:04.714552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9187f-3055-492b-bb7c-df605359f5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:04.715172 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9187f-3055-492b-bb7c-df605359f5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:04.717081 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9187f-3055-492b-bb7c-df605359f5c5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:04.803246 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1361/2711] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:04 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:04.808024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:04.817764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738f3b9-9639-4424-a1ac-c8e4e6416ba6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:04.873324 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46d8bf-02df-402f-a2b3-23914536c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:04.873919 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d8bf-02df-402f-a2b3-23914536c5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:04.874213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d8bf-02df-402f-a2b3-23914536c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:04.874520 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d8bf-02df-402f-a2b3-23914536c5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:04.875149 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46d8bf-02df-402f-a2b3-23914536c5a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:04.877052 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46d8bf-02df-402f-a2b3-23914536c5a0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:04.970073 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1351/2712] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:04 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:04.974157 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9187f-3055-492b-bb7c-df605359f5c5 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:04.986026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9187f-3055-492b-bb7c-df605359f5c5 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:04.992972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a579a-29cc-4342-86ea-506a3d26811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:04.996153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a579a-29cc-4342-86ea-506a3d26811e admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:04.996153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a579a-29cc-4342-86ea-506a3d26811e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:04.996153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a579a-29cc-4342-86ea-506a3d26811e admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:04.996153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a579a-29cc-4342-86ea-506a3d26811e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:04.996559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a579a-29cc-4342-86ea-506a3d26811e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:05.010327 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1362/2713] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:05.011239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46d8bf-02df-402f-a2b3-23914536c5a0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:05.021800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46d8bf-02df-402f-a2b3-23914536c5a0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:05.027001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e46185-22ad-4e7a-b6b0-5c48b8a6364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:05.027602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e46185-22ad-4e7a-b6b0-5c48b8a6364f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:05.027874 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e46185-22ad-4e7a-b6b0-5c48b8a6364f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:05.028144 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e46185-22ad-4e7a-b6b0-5c48b8a6364f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:05.028807 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e46185-22ad-4e7a-b6b0-5c48b8a6364f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:05.030364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e46185-22ad-4e7a-b6b0-5c48b8a6364f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:05.042497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1352/2714] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:05.046536 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a579a-29cc-4342-86ea-506a3d26811e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:05.057008 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a579a-29cc-4342-86ea-506a3d26811e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:05.061923 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:05.062634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:05.062911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:05.063184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] PATH_INFO: `/v3/projects/5f7bf9a7b18f47c396aed066e3b70ebf/users/858bb0e1f1bc44a3abf429f235be670d/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:05.078162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7bf9a7b18f47c396aed066e3b70ebf, user_id=858bb0e1f1bc44a3abf429f235be670d, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:05.080838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:05.167716 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1363/2715] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:05 2022] PUT /identity/v3/projects/5f7bf9a7b18f47c396aed066e3b70ebf/users/858bb0e1f1bc44a3abf429f235be670d/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:05.178821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346417-950d-48a8-af7a-6c3ae42fb4c3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:05.179108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346417-950d-48a8-af7a-6c3ae42fb4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:05.179421 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346417-950d-48a8-af7a-6c3ae42fb4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:05.208091 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-61346417-950d-48a8-af7a-6c3ae42fb4c3 None None] MFA Rules not processed for user `858bb0e1f1bc44a3abf429f235be670d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:05.209297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61346417-950d-48a8-af7a-6c3ae42fb4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:05.274501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1353/2716] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:05.285469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:05.287364 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:05.309815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:05.360098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8d8ba-2bd4-44ac-8e6d-a6f38f29f2c5 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:05.365630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb79b5-b672-449b-9d55-6757a7844769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:05.366217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb79b5-b672-449b-9d55-6757a7844769 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:05.366531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb79b5-b672-449b-9d55-6757a7844769 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:05.366812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb79b5-b672-449b-9d55-6757a7844769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:05.374343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb79b5-b672-449b-9d55-6757a7844769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:05.375934 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb79b5-b672-449b-9d55-6757a7844769 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:05.385003 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1364/2717] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:08.576302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61346417-950d-48a8-af7a-6c3ae42fb4c3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:08.595196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:08.644541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61346417-950d-48a8-af7a-6c3ae42fb4c3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:08.650172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:08.650843 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:08.651120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:08.651395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] PATH_INFO: `/v3/users/858bb0e1f1bc44a3abf429f235be670d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:08.652764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=858bb0e1f1bc44a3abf429f235be670d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:08.654738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:08.862997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858bb0e1f1bc44a3abf429f235be670d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:08.957926 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858bb0e1f1bc44a3abf429f235be670d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:08.966028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858bb0e1f1bc44a3abf429f235be670d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:08.980997 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858bb0e1f1bc44a3abf429f235be670d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:08.981847 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858bb0e1f1bc44a3abf429f235be670d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:08.988637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1354/2718] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:08 2022] DELETE /identity/v3/users/858bb0e1f1bc44a3abf429f235be670d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:08.993461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77dd28-442d-44d2-8af4-e6647ebe9969 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:08.993933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77dd28-442d-44d2-8af4-e6647ebe9969 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:08.994186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77dd28-442d-44d2-8af4-e6647ebe9969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:09.014414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-6a77dd28-442d-44d2-8af4-e6647ebe9969 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:09.016010 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6a77dd28-442d-44d2-8af4-e6647ebe9969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:09.082349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1365/2719] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:09.092302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:09.093744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:09.150958 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd01d7-1fac-4770-98cc-8c327fc2d3ee admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:09.154579 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9ab8-ff9b-47e9-a8db-6c9380585a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:09.155181 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9ab8-ff9b-47e9-a8db-6c9380585a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:09.155457 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9ab8-ff9b-47e9-a8db-6c9380585a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:09.155729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9ab8-ff9b-47e9-a8db-6c9380585a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:09.165085 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9ab8-ff9b-47e9-a8db-6c9380585a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:09.166510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9ab8-ff9b-47e9-a8db-6c9380585a55 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:09.175781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1355/2720] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:09.609619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77dd28-442d-44d2-8af4-e6647ebe9969 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:09.611065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6a77dd28-442d-44d2-8af4-e6647ebe9969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:09.631306 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77dd28-442d-44d2-8af4-e6647ebe9969 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:09.650712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:09.650712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:09.650712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:09.650712 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] PATH_INFO: `/v3/projects/5f7bf9a7b18f47c396aed066e3b70ebf` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:09.651595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7bf9a7b18f47c396aed066e3b70ebf)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:09.651595 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:09.839784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7bf9a7b18f47c396aed066e3b70ebf', 'request_id': 'req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:09.845354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7bf9a7b18f47c396aed066e3b70ebf', 'request_id': 'req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:09.851794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7bf9a7b18f47c396aed066e3b70ebf', 'request_id': 'req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:09.955418 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] The token cache is being invalidate because project 5f7bf9a7b18f47c396aed066e3b70ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:09.955706 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:09.956343 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d0e2ad4d-c22a-452c-847a-a77b9933bc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:09.957922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1366/2721] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:09 2022] DELETE /identity/v3/projects/5f7bf9a7b18f47c396aed066e3b70ebf => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:09.963590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe72f7-2ce9-4bfe-977f-f67e90597114 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:09.964036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe72f7-2ce9-4bfe-977f-f67e90597114 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:09.964158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe72f7-2ce9-4bfe-977f-f67e90597114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:09.987098 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8ffe72f7-2ce9-4bfe-977f-f67e90597114 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:09.988307 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8ffe72f7-2ce9-4bfe-977f-f67e90597114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:10.027263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:10.052608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1356/2722] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:10.060732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1276f7-c111-40c2-9f0b-b0e63750a5d2 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.064736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1276f7-c111-40c2-9f0b-b0e63750a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.064736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1276f7-c111-40c2-9f0b-b0e63750a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.082938 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1c1276f7-c111-40c2-9f0b-b0e63750a5d2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:10.084251 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1c1276f7-c111-40c2-9f0b-b0e63750a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:10.099173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1367/2723] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:54:10.102828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe72f7-2ce9-4bfe-977f-f67e90597114 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:10.114721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe72f7-2ce9-4bfe-977f-f67e90597114 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:10.119382 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:10.120020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.120298 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.120564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.121212 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:54:10.121508 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:10.123146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:10.141491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1357/2724] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:54:10.145639 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1276f7-c111-40c2-9f0b-b0e63750a5d2 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:10.155656 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1276f7-c111-40c2-9f0b-b0e63750a5d2 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:10.160477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c0e1-2ba0-4130-82e7-36cefab52f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:10.161131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c0e1-2ba0-4130-82e7-36cefab52f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.165629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c0e1-2ba0-4130-82e7-36cefab52f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.165629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c0e1-2ba0-4130-82e7-36cefab52f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.165629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c0e1-2ba0-4130-82e7-36cefab52f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:10.165629 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c0e1-2ba0-4130-82e7-36cefab52f21 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:10.250798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:10.257464 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1368/2725] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:10 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:10.262782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:10.273197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b46f3-e109-48ac-9a93-2d669fd9169b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:10.331309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb668-dc33-4401-9174-e0ec2127b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:10.331959 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb668-dc33-4401-9174-e0ec2127b75e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.332230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb668-dc33-4401-9174-e0ec2127b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.332496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacb668-dc33-4401-9174-e0ec2127b75e admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.333119 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacb668-dc33-4401-9174-e0ec2127b75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:10.335088 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacb668-dc33-4401-9174-e0ec2127b75e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:10.441733 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1358/2726] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:10 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:10.443037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c0e1-2ba0-4130-82e7-36cefab52f21 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:10.457142 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c0e1-2ba0-4130-82e7-36cefab52f21 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:10.461868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149c5d-39c4-45ee-8bd0-7cdb7946b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:10.462512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149c5d-39c4-45ee-8bd0-7cdb7946b94a admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.462812 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149c5d-39c4-45ee-8bd0-7cdb7946b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.463088 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75149c5d-39c4-45ee-8bd0-7cdb7946b94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.463738 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75149c5d-39c4-45ee-8bd0-7cdb7946b94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:10.465375 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75149c5d-39c4-45ee-8bd0-7cdb7946b94a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:10.475486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1369/2727] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:10.479603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb668-dc33-4401-9174-e0ec2127b75e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:10.489834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacb668-dc33-4401-9174-e0ec2127b75e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:10.495208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc328ae-6dc9-4515-86dd-5e6c8cf9fa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:10.495805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc328ae-6dc9-4515-86dd-5e6c8cf9fa15 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.496077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc328ae-6dc9-4515-86dd-5e6c8cf9fa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.496351 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc328ae-6dc9-4515-86dd-5e6c8cf9fa15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.496989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc328ae-6dc9-4515-86dd-5e6c8cf9fa15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:10.498609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc328ae-6dc9-4515-86dd-5e6c8cf9fa15 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:10.510419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1359/2728] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:10.514459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149c5d-39c4-45ee-8bd0-7cdb7946b94a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:10.525005 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75149c5d-39c4-45ee-8bd0-7cdb7946b94a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:10.529996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:10.530674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.530954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.531229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] PATH_INFO: `/v3/projects/3a999f3b8468432d812b51a2249c384c/users/545c0790aa9c479d808b45c47cdd4af5/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.547164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a999f3b8468432d812b51a2249c384c, user_id=545c0790aa9c479d808b45c47cdd4af5, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:10.550204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:10.632039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1370/2729] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:10 2022] PUT /identity/v3/projects/3a999f3b8468432d812b51a2249c384c/users/545c0790aa9c479d808b45c47cdd4af5/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:54:10.642510 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734208-d1cc-4233-9bce-f6211abee9b7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.642845 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734208-d1cc-4233-9bce-f6211abee9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.643172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734208-d1cc-4233-9bce-f6211abee9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.672030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c7734208-d1cc-4233-9bce-f6211abee9b7 None None] MFA Rules not processed for user `545c0790aa9c479d808b45c47cdd4af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:10.673236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c7734208-d1cc-4233-9bce-f6211abee9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:10.737751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1360/2730] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:10.749286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:10.751011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:10.808644 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d55946-7485-4174-b1e9-2420a6f8819a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:10.812589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2c9f3-6431-458e-8a15-f5ceb11340b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:10.813184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2c9f3-6431-458e-8a15-f5ceb11340b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:10.813460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2c9f3-6431-458e-8a15-f5ceb11340b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:10.813726 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2c9f3-6431-458e-8a15-f5ceb11340b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:10.822243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2c9f3-6431-458e-8a15-f5ceb11340b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:10.823700 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2c9f3-6431-458e-8a15-f5ceb11340b5 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:10.832640 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1371/2731] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:11.662804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7734208-d1cc-4233-9bce-f6211abee9b7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:11.664124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c7734208-d1cc-4233-9bce-f6211abee9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:11.703792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:11.728690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7734208-d1cc-4233-9bce-f6211abee9b7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:11.733122 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:11.733742 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:11.734016 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:11.734279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] PATH_INFO: `/v3/users/6bc3e8d2b64149d28b5372bf0b1abdc7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:11.735446 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc3e8d2b64149d28b5372bf0b1abdc7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:11.737341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:11.892838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc3e8d2b64149d28b5372bf0b1abdc7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:12.111956 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc3e8d2b64149d28b5372bf0b1abdc7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:12.119977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc3e8d2b64149d28b5372bf0b1abdc7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:12.132402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc3e8d2b64149d28b5372bf0b1abdc7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:12.133125 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc3e8d2b64149d28b5372bf0b1abdc7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:12.139148 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1361/2732] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:11 2022] DELETE /identity/v3/users/6bc3e8d2b64149d28b5372bf0b1abdc7 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:12.143823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2be21-60f9-400d-b96f-b3fab34c837d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:12.150278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2be21-60f9-400d-b96f-b3fab34c837d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:12.150278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2be21-60f9-400d-b96f-b3fab34c837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:12.162560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-7db2be21-60f9-400d-b96f-b3fab34c837d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:12.163736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7db2be21-60f9-400d-b96f-b3fab34c837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:12.224509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1372/2733] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:12.234710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:12.236110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:12.293251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683e8cd-54bb-4e24-b626-ad7091d5ee67 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:12.296939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375dc0b-14bb-4daf-8221-d6d7a6eb956a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:12.297622 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375dc0b-14bb-4daf-8221-d6d7a6eb956a service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:12.297901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375dc0b-14bb-4daf-8221-d6d7a6eb956a service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:12.298174 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375dc0b-14bb-4daf-8221-d6d7a6eb956a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:12.308400 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375dc0b-14bb-4daf-8221-d6d7a6eb956a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:12.309824 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375dc0b-14bb-4daf-8221-d6d7a6eb956a service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:12.319761 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1362/2734] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:12.747898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2be21-60f9-400d-b96f-b3fab34c837d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:12.748323 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-7db2be21-60f9-400d-b96f-b3fab34c837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:12.761305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2be21-60f9-400d-b96f-b3fab34c837d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:12.767261 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:12.771672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:12.771672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:12.771672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] PATH_INFO: `/v3/projects/f6f9815f49234eda8aae568484b912be` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:12.771672 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f9815f49234eda8aae568484b912be)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:12.773288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:12.901186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f9815f49234eda8aae568484b912be', 'request_id': 'req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:12.906839 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f9815f49234eda8aae568484b912be', 'request_id': 'req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:12.912954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f9815f49234eda8aae568484b912be', 'request_id': 'req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:12.914632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:13.003514 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] The token cache is being invalidate because project f6f9815f49234eda8aae568484b912be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:13.008177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.008177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.008177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1373/2735] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:12 2022] DELETE /identity/v3/projects/f6f9815f49234eda8aae568484b912be => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:13.010485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375dc0b-14bb-4daf-8221-d6d7a6eb956a service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:13.020503 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375dc0b-14bb-4daf-8221-d6d7a6eb956a service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:13.073759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:13.079791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:13.080418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:13.080719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:13.080989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] PATH_INFO: `/v3/users/9241a62d970e441a8131e8469d90ae04` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:13.082131 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9241a62d970e441a8131e8469d90ae04)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:13.088744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:13.312240 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9241a62d970e441a8131e8469d90ae04'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.363320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9241a62d970e441a8131e8469d90ae04'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.371420 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9241a62d970e441a8131e8469d90ae04'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.383218 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9241a62d970e441a8131e8469d90ae04'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.384435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-051aea7d-bd4e-4883-a402-7c892649b1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9241a62d970e441a8131e8469d90ae04'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.390922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1363/2736] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:13 2022] DELETE /identity/v3/users/9241a62d970e441a8131e8469d90ae04 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:13.797733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:13.797733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:13.807792 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3ac4a-bf09-4dee-9099-41e1fe675a4c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:13.864397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:13.865020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:13.865293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:13.865560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] PATH_INFO: `/v3/projects/40fcd0945bdc48fda2792cbd177fb0d0` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:13.866688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fcd0945bdc48fda2792cbd177fb0d0)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:13.869229 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:13.985564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fcd0945bdc48fda2792cbd177fb0d0', 'request_id': 'req-a4c84d54-b492-4c01-93a5-c9bd49fee591'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.991162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fcd0945bdc48fda2792cbd177fb0d0', 'request_id': 'req-a4c84d54-b492-4c01-93a5-c9bd49fee591'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:13.997754 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fcd0945bdc48fda2792cbd177fb0d0', 'request_id': 'req-a4c84d54-b492-4c01-93a5-c9bd49fee591'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:14.077255 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] The token cache is being invalidate because project 40fcd0945bdc48fda2792cbd177fb0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:14.077480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:14.078103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a4c84d54-b492-4c01-93a5-c9bd49fee591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:14.079671 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1374/2737] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:13 2022] DELETE /identity/v3/projects/40fcd0945bdc48fda2792cbd177fb0d0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:14.084499 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd98c-f34d-4446-962c-4e123708f1d2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.089882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd98c-f34d-4446-962c-4e123708f1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.089882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd98c-f34d-4446-962c-4e123708f1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.104172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f5fcd98c-f34d-4446-962c-4e123708f1d2 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:14.105441 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f5fcd98c-f34d-4446-962c-4e123708f1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:14.165752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1364/2738] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:14.173507 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed2eca-f0b1-43db-a93a-5aadcbe7b6f1 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.173907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed2eca-f0b1-43db-a93a-5aadcbe7b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.174191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed2eca-f0b1-43db-a93a-5aadcbe7b6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.194313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-49ed2eca-f0b1-43db-a93a-5aadcbe7b6f1 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:14.195830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-49ed2eca-f0b1-43db-a93a-5aadcbe7b6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:14.204356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1375/2739] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:14.208544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd98c-f34d-4446-962c-4e123708f1d2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:14.218191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd98c-f34d-4446-962c-4e123708f1d2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:14.222916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:14.223507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.223786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.224059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.224708 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:54:14.225057 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:14.226688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:14.238228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1365/2740] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:54:14.242284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed2eca-f0b1-43db-a93a-5aadcbe7b6f1 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:14.252016 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed2eca-f0b1-43db-a93a-5aadcbe7b6f1 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:14.256739 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:14.257325 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.257600 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.257868 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.259223 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:14.261110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:14.387176 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1376/2741] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:14 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:14.397423 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:14.425156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312f5b-213f-4f43-835d-e3d4e1810546 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:14.505242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354bf5-527a-439f-ad27-2ff9c9647197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:14.506249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354bf5-527a-439f-ad27-2ff9c9647197 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.506685 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354bf5-527a-439f-ad27-2ff9c9647197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.507056 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354bf5-527a-439f-ad27-2ff9c9647197 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.508883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80354bf5-527a-439f-ad27-2ff9c9647197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:14.511947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80354bf5-527a-439f-ad27-2ff9c9647197 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:14.519305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:14.521205 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:14.526846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:14.585382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:14.607715 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357b28-d407-4d6a-9b35-553b6b6d8ecb admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:14.613954 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:14.614099 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.614346 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.614652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.616423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:14.629436 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:14.631484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:14.658423 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1377/2742] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:14.671785 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1366/2743] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:14 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:14.673061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:14.684455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c43c-39e2-44f8-9835-5c521a5eb814 service nova] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:14.689173 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be3faf-da61-4763-a97b-6482325b2b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:14.689773 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be3faf-da61-4763-a97b-6482325b2b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.690053 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be3faf-da61-4763-a97b-6482325b2b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.690328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be3faf-da61-4763-a97b-6482325b2b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.691028 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be3faf-da61-4763-a97b-6482325b2b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:14.692641 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be3faf-da61-4763-a97b-6482325b2b60 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:14.703742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1378/2744] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:14.707794 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354bf5-527a-439f-ad27-2ff9c9647197 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:14.717963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354bf5-527a-439f-ad27-2ff9c9647197 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:14.724593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455d9b6-f19a-412c-af29-85b453b66545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:14.724593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d9b6-f19a-412c-af29-85b453b66545 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.724593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d9b6-f19a-412c-af29-85b453b66545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.724970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d9b6-f19a-412c-af29-85b453b66545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.725434 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455d9b6-f19a-412c-af29-85b453b66545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:14.727064 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455d9b6-f19a-412c-af29-85b453b66545 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:14.737755 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1367/2745] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:14.741926 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be3faf-da61-4763-a97b-6482325b2b60 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:14.752208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be3faf-da61-4763-a97b-6482325b2b60 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:14.756842 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b83089-3d0e-40e0-9a33-c088e7dff1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:14.757480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83089-3d0e-40e0-9a33-c088e7dff1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.757756 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83089-3d0e-40e0-9a33-c088e7dff1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.758021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83089-3d0e-40e0-9a33-c088e7dff1c7 admin admin] PATH_INFO: `/v3/projects/22626ac481f147f89cb11b17ffec8613/users/41cba9d7f20044a0a31c789e82ee91f8/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.773015 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b83089-3d0e-40e0-9a33-c088e7dff1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22626ac481f147f89cb11b17ffec8613, user_id=41cba9d7f20044a0a31c789e82ee91f8, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:14.776813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b83089-3d0e-40e0-9a33-c088e7dff1c7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:14.859461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1379/2746] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:14 2022] PUT /identity/v3/projects/22626ac481f147f89cb11b17ffec8613/users/41cba9d7f20044a0a31c789e82ee91f8/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:14.871353 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2865-8044-4fd2-9164-c649826b9edf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:14.871639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2865-8044-4fd2-9164-c649826b9edf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:14.871915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b2865-8044-4fd2-9164-c649826b9edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:14.900362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6b3b2865-8044-4fd2-9164-c649826b9edf None None] MFA Rules not processed for user `41cba9d7f20044a0a31c789e82ee91f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:14.901569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6b3b2865-8044-4fd2-9164-c649826b9edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:14.996276 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1368/2747] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:14.997408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b83089-3d0e-40e0-9a33-c088e7dff1c7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.040105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b2865-8044-4fd2-9164-c649826b9edf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.040105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6b3b2865-8044-4fd2-9164-c649826b9edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:15.072548 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b83089-3d0e-40e0-9a33-c088e7dff1c7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.085076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959efca3-2062-4787-b8ca-be6b5457948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.085941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efca3-2062-4787-b8ca-be6b5457948b admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.090568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efca3-2062-4787-b8ca-be6b5457948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.090568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efca3-2062-4787-b8ca-be6b5457948b admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.091778 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959efca3-2062-4787-b8ca-be6b5457948b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.094235 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959efca3-2062-4787-b8ca-be6b5457948b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.121110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b2865-8044-4fd2-9164-c649826b9edf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.124972 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.125692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.125969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.126239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.128013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:15.138196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.140329 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.148936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1369/2748] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:15.191606 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1380/2749] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:14 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:15.195971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.207110 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe398f1b-e65d-417d-92d1-eb3b9afac7f7 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.221823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959efca3-2062-4787-b8ca-be6b5457948b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.271402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312da21-66c7-4146-b392-1c9964ff0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.272011 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312da21-66c7-4146-b392-1c9964ff0d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.272283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312da21-66c7-4146-b392-1c9964ff0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.272665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312da21-66c7-4146-b392-1c9964ff0d7a admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.273816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312da21-66c7-4146-b392-1c9964ff0d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.275744 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312da21-66c7-4146-b392-1c9964ff0d7a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.282208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959efca3-2062-4787-b8ca-be6b5457948b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.285860 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.286452 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.286760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.287031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.288824 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:15.358486 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.359921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.370625 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1381/2750] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:54:15.429638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1370/2751] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:15 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:54:15.431574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312da21-66c7-4146-b392-1c9964ff0d7a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.431751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.433031 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:15.439108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:15.443099 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312da21-66c7-4146-b392-1c9964ff0d7a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.448379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3ce7-3eb7-4f3d-bc0b-f69a38ae424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.448964 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3ce7-3eb7-4f3d-bc0b-f69a38ae424d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.449239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3ce7-3eb7-4f3d-bc0b-f69a38ae424d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.449506 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3ce7-3eb7-4f3d-bc0b-f69a38ae424d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.450141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc3ce7-3eb7-4f3d-bc0b-f69a38ae424d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.451800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc3ce7-3eb7-4f3d-bc0b-f69a38ae424d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.461573 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1371/2752] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:54:15.465734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3ce7-3eb7-4f3d-bc0b-f69a38ae424d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.475569 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3ce7-3eb7-4f3d-bc0b-f69a38ae424d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.479615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:15.480589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562d7a7-ac9b-44ad-aa25-6a4398962ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.481217 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562d7a7-ac9b-44ad-aa25-6a4398962ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.481490 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562d7a7-ac9b-44ad-aa25-6a4398962ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.481752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562d7a7-ac9b-44ad-aa25-6a4398962ef1 admin admin] PATH_INFO: `/v3/projects/7c314d4d887b48278c92fcb9361f5981/users/1716ddb666e3438aa98c7563d17b43d8/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.497114 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562d7a7-ac9b-44ad-aa25-6a4398962ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c314d4d887b48278c92fcb9361f5981, user_id=1716ddb666e3438aa98c7563d17b43d8, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.499944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562d7a7-ac9b-44ad-aa25-6a4398962ef1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.504749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813f84-3ce3-4bb6-9d10-0c0c076c00a5 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.510383 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.511006 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.521611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.521611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.521611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:15.524858 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.526398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.536073 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1382/2753] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:15.604912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1372/2754] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:15 2022] PUT /identity/v3/projects/7c314d4d887b48278c92fcb9361f5981/users/1716ddb666e3438aa98c7563d17b43d8/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:54:15.608932 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.619397 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0d36c-07e8-454f-8bd1-52e681e04303 service placement] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.678144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec456d4-127a-4050-95fa-52f6c6b8ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.678885 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec456d4-127a-4050-95fa-52f6c6b8ffd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.679165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec456d4-127a-4050-95fa-52f6c6b8ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.679432 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec456d4-127a-4050-95fa-52f6c6b8ffd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.680071 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec456d4-127a-4050-95fa-52f6c6b8ffd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.681752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec456d4-127a-4050-95fa-52f6c6b8ffd4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.691530 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1383/2755] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:15.695899 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562d7a7-ac9b-44ad-aa25-6a4398962ef1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.706795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562d7a7-ac9b-44ad-aa25-6a4398962ef1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.712183 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.712930 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.713214 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.713489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] PATH_INFO: `/v3/projects/7c314d4d887b48278c92fcb9361f5981/users/1716ddb666e3438aa98c7563d17b43d8/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.715531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c314d4d887b48278c92fcb9361f5981, user_id=1716ddb666e3438aa98c7563d17b43d8, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.718156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.729249 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1373/2756] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:15 2022] PUT /identity/v3/projects/7c314d4d887b48278c92fcb9361f5981/users/1716ddb666e3438aa98c7563d17b43d8/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:15.739872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448247-7437-4588-bd24-2794198b6e56 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.740162 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448247-7437-4588-bd24-2794198b6e56 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.740465 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448247-7437-4588-bd24-2794198b6e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.768161 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-37448247-7437-4588-bd24-2794198b6e56 None None] MFA Rules not processed for user `1716ddb666e3438aa98c7563d17b43d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:15.769368 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-37448247-7437-4588-bd24-2794198b6e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:15.814564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=100 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:15.844054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1384/2757] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:15.852121 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:15.853839 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:15.913810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197e03b-a3a0-48cc-a5bc-693fa2f91b13 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:15.917475 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95872bb-ebde-4cc7-8b62-10375523d6e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:15.918079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95872bb-ebde-4cc7-8b62-10375523d6e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:15.918355 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95872bb-ebde-4cc7-8b62-10375523d6e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:15.918654 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95872bb-ebde-4cc7-8b62-10375523d6e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:15.927842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95872bb-ebde-4cc7-8b62-10375523d6e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:15.934773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95872bb-ebde-4cc7-8b62-10375523d6e5 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:15.939024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1374/2758] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:15.969113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448247-7437-4588-bd24-2794198b6e56 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:16.032753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448247-7437-4588-bd24-2794198b6e56 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:16.037528 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:16.038191 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:16.038484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:16.038753 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] PATH_INFO: `/v3/users/41cba9d7f20044a0a31c789e82ee91f8` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:16.039907 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41cba9d7f20044a0a31c789e82ee91f8)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:16.041910 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:16.257846 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41cba9d7f20044a0a31c789e82ee91f8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:16.266743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41cba9d7f20044a0a31c789e82ee91f8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:16.338305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41cba9d7f20044a0a31c789e82ee91f8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:16.339219 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41cba9d7f20044a0a31c789e82ee91f8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:16.354169 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41cba9d7f20044a0a31c789e82ee91f8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:16.361153 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1385/2759] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:15 2022] DELETE /identity/v3/users/41cba9d7f20044a0a31c789e82ee91f8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:16.365739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81931347-b4f3-4958-bf22-d11a52129eb0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:16.366199 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81931347-b4f3-4958-bf22-d11a52129eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:16.366313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81931347-b4f3-4958-bf22-d11a52129eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:16.385922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-81931347-b4f3-4958-bf22-d11a52129eb0 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:16.387161 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-81931347-b4f3-4958-bf22-d11a52129eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:16.450763 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1375/2760] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:16.460311 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:16.461709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:16.518655 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604af60-c8f3-4a32-8c0d-fc2a8f579030 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:16.522390 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f85c-14b1-4793-88ef-7b5b4c9cc5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:16.523021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f85c-14b1-4793-88ef-7b5b4c9cc5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:16.523298 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f85c-14b1-4793-88ef-7b5b4c9cc5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:16.523565 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f85c-14b1-4793-88ef-7b5b4c9cc5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:16.532688 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375f85c-14b1-4793-88ef-7b5b4c9cc5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:16.534097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375f85c-14b1-4793-88ef-7b5b4c9cc5f3 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:16.544193 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1386/2761] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:16.931860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81931347-b4f3-4958-bf22-d11a52129eb0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:16.935803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-81931347-b4f3-4958-bf22-d11a52129eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:16.948246 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81931347-b4f3-4958-bf22-d11a52129eb0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:16.952907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:16.953540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:16.953821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:16.954154 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] PATH_INFO: `/v3/projects/22626ac481f147f89cb11b17ffec8613` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:16.955419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22626ac481f147f89cb11b17ffec8613)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:16.957357 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:17.091296 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22626ac481f147f89cb11b17ffec8613', 'request_id': 'req-c91383fd-408a-4871-8aa7-e01c6a4e8860'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.095053 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:17.184418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22626ac481f147f89cb11b17ffec8613', 'request_id': 'req-c91383fd-408a-4871-8aa7-e01c6a4e8860'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.191274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22626ac481f147f89cb11b17ffec8613', 'request_id': 'req-c91383fd-408a-4871-8aa7-e01c6a4e8860'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.202660 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] The token cache is being invalidate because project 22626ac481f147f89cb11b17ffec8613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:17.202944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.203592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.205087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1376/2762] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:16 2022] DELETE /identity/v3/projects/22626ac481f147f89cb11b17ffec8613 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:17.209098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f85c-14b1-4793-88ef-7b5b4c9cc5f3 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:17.215322 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:17.221833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f85c-14b1-4793-88ef-7b5b4c9cc5f3 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:17.285886 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:17.286560 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:17.286852 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:17.287127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] PATH_INFO: `/v3/users/1716ddb666e3438aa98c7563d17b43d8` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:17.288399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1716ddb666e3438aa98c7563d17b43d8)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:17.290309 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:17.473720 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1716ddb666e3438aa98c7563d17b43d8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.482817 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1716ddb666e3438aa98c7563d17b43d8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.575502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1716ddb666e3438aa98c7563d17b43d8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.576216 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1716ddb666e3438aa98c7563d17b43d8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.589017 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-863ecdf9-3111-4bfb-ba41-583a89b2dfbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1716ddb666e3438aa98c7563d17b43d8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:17.601320 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1387/2763] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:17 2022] DELETE /identity/v3/users/1716ddb666e3438aa98c7563d17b43d8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:54:18.065464 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:18.067496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:18.083316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91383fd-408a-4871-8aa7-e01c6a4e8860 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:18.143536 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:18.144089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.144402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.144670 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] PATH_INFO: `/v3/projects/7c314d4d887b48278c92fcb9361f5981` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.145809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c314d4d887b48278c92fcb9361f5981)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:18.147743 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:18.290322 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c314d4d887b48278c92fcb9361f5981', 'request_id': 'req-b88d8b8d-2b6e-4cba-81f2-44db84021695'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:18.357855 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c314d4d887b48278c92fcb9361f5981', 'request_id': 'req-b88d8b8d-2b6e-4cba-81f2-44db84021695'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:18.365318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c314d4d887b48278c92fcb9361f5981', 'request_id': 'req-b88d8b8d-2b6e-4cba-81f2-44db84021695'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:18.377126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] The token cache is being invalidate because project 7c314d4d887b48278c92fcb9361f5981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:18.377411 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:18.378067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b88d8b8d-2b6e-4cba-81f2-44db84021695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:18.379603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1377/2764] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:18 2022] DELETE /identity/v3/projects/7c314d4d887b48278c92fcb9361f5981 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:18.384284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55a728-b9b4-49e6-95f9-8e49bdd48c08 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.385319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55a728-b9b4-49e6-95f9-8e49bdd48c08 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.385319 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55a728-b9b4-49e6-95f9-8e49bdd48c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.405352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-8b55a728-b9b4-49e6-95f9-8e49bdd48c08 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:18.406498 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8b55a728-b9b4-49e6-95f9-8e49bdd48c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:18.466021 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1388/2765] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:18.473724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2c4b3-e98a-48a6-947f-fe03c667e867 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.474006 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2c4b3-e98a-48a6-947f-fe03c667e867 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.474282 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2c4b3-e98a-48a6-947f-fe03c667e867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.494828 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-03a2c4b3-e98a-48a6-947f-fe03c667e867 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:18.501704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03a2c4b3-e98a-48a6-947f-fe03c667e867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:18.508040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1378/2766] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:18.509215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55a728-b9b4-49e6-95f9-8e49bdd48c08 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:18.520370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55a728-b9b4-49e6-95f9-8e49bdd48c08 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:18.525608 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:18.526202 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.526506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.526781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.536850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:54:18.536850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:18.536850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:18.541613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1389/2767] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:54:18.546081 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2c4b3-e98a-48a6-947f-fe03c667e867 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:18.555795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2c4b3-e98a-48a6-947f-fe03c667e867 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:18.561126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15d48c-e747-42a4-a971-a5d1a7203ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:18.561745 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15d48c-e747-42a4-a971-a5d1a7203ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.565297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15d48c-e747-42a4-a971-a5d1a7203ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.565297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15d48c-e747-42a4-a971-a5d1a7203ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.565297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15d48c-e747-42a4-a971-a5d1a7203ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:18.565297 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15d48c-e747-42a4-a971-a5d1a7203ea8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:18.686961 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1379/2768] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:18 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:18.688273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:18.698902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a8cf5-742e-4553-914f-c5c299d6da1b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:18.703741 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:18.764201 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d161-b9ca-4601-a151-e412d07cad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:18.764901 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d161-b9ca-4601-a151-e412d07cad68 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.765531 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d161-b9ca-4601-a151-e412d07cad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.765987 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d161-b9ca-4601-a151-e412d07cad68 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.766733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8d161-b9ca-4601-a151-e412d07cad68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:18.768838 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8d161-b9ca-4601-a151-e412d07cad68 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:18.849737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1390/2769] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:18 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:18.854287 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15d48c-e747-42a4-a971-a5d1a7203ea8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:18.864543 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15d48c-e747-42a4-a971-a5d1a7203ea8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:18.869985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e06e-b56c-4811-bdbe-ecc68f932870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:18.873283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e06e-b56c-4811-bdbe-ecc68f932870 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.873283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e06e-b56c-4811-bdbe-ecc68f932870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.873283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e06e-b56c-4811-bdbe-ecc68f932870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.873283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618e06e-b56c-4811-bdbe-ecc68f932870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:18.873656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618e06e-b56c-4811-bdbe-ecc68f932870 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:18.883861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1380/2770] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:18.887944 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d161-b9ca-4601-a151-e412d07cad68 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:18.898301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d161-b9ca-4601-a151-e412d07cad68 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:18.905922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be95f6a-1843-41d8-a3aa-22c1f89d8526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:18.905922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95f6a-1843-41d8-a3aa-22c1f89d8526 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.905922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95f6a-1843-41d8-a3aa-22c1f89d8526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.905922 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95f6a-1843-41d8-a3aa-22c1f89d8526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.906445 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be95f6a-1843-41d8-a3aa-22c1f89d8526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:18.907439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be95f6a-1843-41d8-a3aa-22c1f89d8526 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:18.922502 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1391/2771] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:18.927032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e06e-b56c-4811-bdbe-ecc68f932870 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:18.938402 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e06e-b56c-4811-bdbe-ecc68f932870 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:18.943071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:18.943759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:18.944032 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:18.944301 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] PATH_INFO: `/v3/projects/80bae457273d47b99c198626f7e95424/users/0de8dfbec84b4ad3befa73c1b7ba03f5/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:18.959206 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80bae457273d47b99c198626f7e95424, user_id=0de8dfbec84b4ad3befa73c1b7ba03f5, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:18.961906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:19.024045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1381/2772] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:18 2022] PUT /identity/v3/projects/80bae457273d47b99c198626f7e95424/users/0de8dfbec84b4ad3befa73c1b7ba03f5/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:19.029194 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eafcf1-081f-48f1-bd3c-a88edbefef15 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:19.029477 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eafcf1-081f-48f1-bd3c-a88edbefef15 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:19.029748 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eafcf1-081f-48f1-bd3c-a88edbefef15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:19.048524 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-91eafcf1-081f-48f1-bd3c-a88edbefef15 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:19.049697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-91eafcf1-081f-48f1-bd3c-a88edbefef15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:19.106984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1392/2773] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:19.116525 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:19.118196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:19.130915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:19.177267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9c5d5-6773-43a2-9e0a-0a973616caf4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:19.180944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e5d6-eb98-4e18-9ac8-37d5ad033fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:19.181544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e5d6-eb98-4e18-9ac8-37d5ad033fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:19.181819 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e5d6-eb98-4e18-9ac8-37d5ad033fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:19.182089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e5d6-eb98-4e18-9ac8-37d5ad033fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:19.190851 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28e5d6-eb98-4e18-9ac8-37d5ad033fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:19.192710 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28e5d6-eb98-4e18-9ac8-37d5ad033fe8 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:19.202251 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1382/2774] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:20.685462 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041944-b00e-45d4-b08c-3dad12cacf0a None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:20.686030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041944-b00e-45d4-b08c-3dad12cacf0a None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:20.686030 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041944-b00e-45d4-b08c-3dad12cacf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:20.716244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-0f041944-b00e-45d4-b08c-3dad12cacf0a None None] MFA Rules not processed for user `0de8dfbec84b4ad3befa73c1b7ba03f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:20.717840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0f041944-b00e-45d4-b08c-3dad12cacf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:20.789957 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1393/2775] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:20.795047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e5d6-eb98-4e18-9ac8-37d5ad033fe8 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:20.804599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e5d6-eb98-4e18-9ac8-37d5ad033fe8 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:20.811678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd4f8d-05ca-4c8f-9260-6b2c9d216400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:20.811678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4f8d-05ca-4c8f-9260-6b2c9d216400 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:20.811678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4f8d-05ca-4c8f-9260-6b2c9d216400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:20.811678 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd4f8d-05ca-4c8f-9260-6b2c9d216400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:20.812082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd4f8d-05ca-4c8f-9260-6b2c9d216400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:20.812989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd4f8d-05ca-4c8f-9260-6b2c9d216400 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:20.908672 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1383/2776] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:20 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:20.912714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f041944-b00e-45d4-b08c-3dad12cacf0a None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:20.924132 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f041944-b00e-45d4-b08c-3dad12cacf0a None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:20.936887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:20.981736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e58f3-2c15-46d7-b755-111c2715f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:20.982341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e58f3-2c15-46d7-b755-111c2715f303 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:20.982652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e58f3-2c15-46d7-b755-111c2715f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:20.982974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e58f3-2c15-46d7-b755-111c2715f303 admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:20.983619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e58f3-2c15-46d7-b755-111c2715f303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:20.985532 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e58f3-2c15-46d7-b755-111c2715f303 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:21.037976 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1394/2777] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:20 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:21.041861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd4f8d-05ca-4c8f-9260-6b2c9d216400 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:21.052656 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd4f8d-05ca-4c8f-9260-6b2c9d216400 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:21.057429 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805cb25-0520-4ab6-871c-60811f14b601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:21.058029 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805cb25-0520-4ab6-871c-60811f14b601 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:21.058300 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805cb25-0520-4ab6-871c-60811f14b601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:21.058605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805cb25-0520-4ab6-871c-60811f14b601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:21.059274 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805cb25-0520-4ab6-871c-60811f14b601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:21.060857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805cb25-0520-4ab6-871c-60811f14b601 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:21.071653 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1384/2778] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:21.076332 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e58f3-2c15-46d7-b755-111c2715f303 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:21.087137 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e58f3-2c15-46d7-b755-111c2715f303 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:21.092643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270e7ed-d04d-49e4-a92e-d1f5d4fa79b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:21.093352 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e7ed-d04d-49e4-a92e-d1f5d4fa79b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:21.093948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e7ed-d04d-49e4-a92e-d1f5d4fa79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:21.093948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e7ed-d04d-49e4-a92e-d1f5d4fa79b4 admin admin] PATH_INFO: `/v3/projects/63a0705292bb481aabe1c9c7c973a120/users/2d7fe777de5d437a9d123bda09f42b26/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:21.109075 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270e7ed-d04d-49e4-a92e-d1f5d4fa79b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a0705292bb481aabe1c9c7c973a120, user_id=2d7fe777de5d437a9d123bda09f42b26, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:21.111762 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270e7ed-d04d-49e4-a92e-d1f5d4fa79b4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:21.221266 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1395/2779] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:21 2022] PUT /identity/v3/projects/63a0705292bb481aabe1c9c7c973a120/users/2d7fe777de5d437a9d123bda09f42b26/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:21.225269 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805cb25-0520-4ab6-871c-60811f14b601 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:21.235139 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805cb25-0520-4ab6-871c-60811f14b601 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:21.290553 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:21.291177 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:21.291452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:21.291716 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:21.292345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:21.293971 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:21.303848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1385/2780] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:21.307986 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270e7ed-d04d-49e4-a92e-d1f5d4fa79b4 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:21.318141 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270e7ed-d04d-49e4-a92e-d1f5d4fa79b4 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:21.323164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3522be-35bf-4802-8268-95f50446851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:21.323798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3522be-35bf-4802-8268-95f50446851f admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:21.324103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3522be-35bf-4802-8268-95f50446851f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:21.324342 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3522be-35bf-4802-8268-95f50446851f admin admin] PATH_INFO: `/v3/projects/63a0705292bb481aabe1c9c7c973a120/users/2d7fe777de5d437a9d123bda09f42b26/roles/45149274288845b0a73e18fbb3394202` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:21.326244 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3522be-35bf-4802-8268-95f50446851f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a0705292bb481aabe1c9c7c973a120, user_id=2d7fe777de5d437a9d123bda09f42b26, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:21.328915 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3522be-35bf-4802-8268-95f50446851f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:21.339305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1396/2781] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:21 2022] PUT /identity/v3/projects/63a0705292bb481aabe1c9c7c973a120/users/2d7fe777de5d437a9d123bda09f42b26/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:21.888915 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:21.890923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:21.904115 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c197355-1917-4fd6-ae23-115d875f60e4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:21.968405 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:21.969037 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:21.969316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:21.969585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] PATH_INFO: `/v3/users/545c0790aa9c479d808b45c47cdd4af5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:21.970759 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545c0790aa9c479d808b45c47cdd4af5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:21.972674 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:21.991844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:22.135419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545c0790aa9c479d808b45c47cdd4af5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:22.226424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545c0790aa9c479d808b45c47cdd4af5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:22.234881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545c0790aa9c479d808b45c47cdd4af5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:22.252532 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545c0790aa9c479d808b45c47cdd4af5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:22.254452 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545c0790aa9c479d808b45c47cdd4af5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:22.260751 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1386/2782] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:21 2022] DELETE /identity/v3/users/545c0790aa9c479d808b45c47cdd4af5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:22.265556 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa23b-b16f-4922-86d1-baff0adfc6d8 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:22.266020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa23b-b16f-4922-86d1-baff0adfc6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:22.266144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa23b-b16f-4922-86d1-baff0adfc6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:22.286673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-4dfaa23b-b16f-4922-86d1-baff0adfc6d8 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:22.287930 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-4dfaa23b-b16f-4922-86d1-baff0adfc6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:22.350620 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1397/2783] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:22.360507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:22.361935 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:22.421220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7f44b-ec6d-4633-9286-24fefeceeb87 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:22.424882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:22.425482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:22.432623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:22.432623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:22.435664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:22.437086 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:22.446239 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1387/2784] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 08:54:22.690794 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbf744-47b5-449d-be60-db2cd38549bd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:22.691236 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbf744-47b5-449d-be60-db2cd38549bd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:22.691509 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbf744-47b5-449d-be60-db2cd38549bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:22.723615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-72cbf744-47b5-449d-be60-db2cd38549bd None None] MFA Rules not processed for user `2d7fe777de5d437a9d123bda09f42b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:22.725459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-72cbf744-47b5-449d-be60-db2cd38549bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:22.797627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:22.807057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1398/2785] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:22.818365 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:22.819780 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:22.875293 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbf744-47b5-449d-be60-db2cd38549bd None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:22.877413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-72cbf744-47b5-449d-be60-db2cd38549bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:22.878723 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87e8e-f8f1-49b6-9cdb-890bc4456e5c service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:22.882618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e02642-48d6-46c7-8439-494f05d40f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:22.883228 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e02642-48d6-46c7-8439-494f05d40f6a service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:22.883502 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e02642-48d6-46c7-8439-494f05d40f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:22.883765 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e02642-48d6-46c7-8439-494f05d40f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:22.886283 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e4e02642-48d6-46c7-8439-494f05d40f6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:22.892203 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbf744-47b5-449d-be60-db2cd38549bd None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:22.906695 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:22.907490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:22.907772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:22.908044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] PATH_INFO: `/v3/projects/3a999f3b8468432d812b51a2249c384c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:22.909258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a999f3b8468432d812b51a2249c384c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:22.911204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:22.945591 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:22.956273 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e02642-48d6-46c7-8439-494f05d40f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:22.957739 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e02642-48d6-46c7-8439-494f05d40f6a service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:22.967330 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1388/2786] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:23.050992 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a999f3b8468432d812b51a2249c384c', 'request_id': 'req-a1628924-9e59-4b82-ac12-e911eb1a10b4'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:23.056363 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a999f3b8468432d812b51a2249c384c', 'request_id': 'req-a1628924-9e59-4b82-ac12-e911eb1a10b4'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:23.062408 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a999f3b8468432d812b51a2249c384c', 'request_id': 'req-a1628924-9e59-4b82-ac12-e911eb1a10b4'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:23.171727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] The token cache is being invalidate because project 3a999f3b8468432d812b51a2249c384c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:23.172024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:23.172691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a1628924-9e59-4b82-ac12-e911eb1a10b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:23.174186 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1399/2787] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:22 2022] DELETE /identity/v3/projects/3a999f3b8468432d812b51a2249c384c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:23.179195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d8d7-4f41-4de8-940d-70bd4d4fd615 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.179478 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d8d7-4f41-4de8-940d-70bd4d4fd615 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.179748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d8d7-4f41-4de8-940d-70bd4d4fd615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.200038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1012d8d7-4f41-4de8-940d-70bd4d4fd615 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:23.201361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1012d8d7-4f41-4de8-940d-70bd4d4fd615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:23.261192 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1389/2788] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:54:23.270604 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5acd9-a9de-4154-87e2-a669ef96aafd None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.271124 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5acd9-a9de-4154-87e2-a669ef96aafd None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.271241 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5acd9-a9de-4154-87e2-a669ef96aafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.291156 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-eca5acd9-a9de-4154-87e2-a669ef96aafd None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:23.292349 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-eca5acd9-a9de-4154-87e2-a669ef96aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:23.300484 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1400/2789] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:54:23.304691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012d8d7-4f41-4de8-940d-70bd4d4fd615 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:23.314882 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012d8d7-4f41-4de8-940d-70bd4d4fd615 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:23.319444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:23.320036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.320313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.320582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.321230 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:54:23.321527 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:23.323179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:23.334419 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1390/2790] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:54:23.338661 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5acd9-a9de-4154-87e2-a669ef96aafd None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:23.347821 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5acd9-a9de-4154-87e2-a669ef96aafd None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:23.352652 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e85a14-307f-4423-ae22-3367be97b864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:23.353837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e85a14-307f-4423-ae22-3367be97b864 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.354204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e85a14-307f-4423-ae22-3367be97b864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.354569 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e85a14-307f-4423-ae22-3367be97b864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.355252 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e85a14-307f-4423-ae22-3367be97b864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:23.357387 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e85a14-307f-4423-ae22-3367be97b864 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:23.456635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1401/2791] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:23 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:23.460690 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:23.471379 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98059-1cf2-481c-85d2-84bd298cc23c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:23.529362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d25b-4287-4907-8063-97e2e80d78c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:23.529967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d25b-4287-4907-8063-97e2e80d78c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.530247 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d25b-4287-4907-8063-97e2e80d78c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.530561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d25b-4287-4907-8063-97e2e80d78c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.531193 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d25b-4287-4907-8063-97e2e80d78c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:23.533120 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d25b-4287-4907-8063-97e2e80d78c4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:23.629453 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1391/2792] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:23 2022] POST /identity/v3/users => generated 303 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:54:23.633542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e85a14-307f-4423-ae22-3367be97b864 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:23.644138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e85a14-307f-4423-ae22-3367be97b864 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:23.648937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7edf89-99c1-41e7-8b11-15df96380a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:23.649535 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edf89-99c1-41e7-8b11-15df96380a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.649813 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edf89-99c1-41e7-8b11-15df96380a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.650597 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edf89-99c1-41e7-8b11-15df96380a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.651288 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7edf89-99c1-41e7-8b11-15df96380a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:23.652876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7edf89-99c1-41e7-8b11-15df96380a63 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:23.670698 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1402/2793] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:23.672063 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d25b-4287-4907-8063-97e2e80d78c4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:23.682696 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d25b-4287-4907-8063-97e2e80d78c4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:23.687580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78acd2-8656-4579-a8e8-17fcc09f315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:23.698627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78acd2-8656-4579-a8e8-17fcc09f315d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.698627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78acd2-8656-4579-a8e8-17fcc09f315d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.698627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78acd2-8656-4579-a8e8-17fcc09f315d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.698627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78acd2-8656-4579-a8e8-17fcc09f315d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:23.698627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78acd2-8656-4579-a8e8-17fcc09f315d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:23.703373 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1392/2794] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:23.711677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7edf89-99c1-41e7-8b11-15df96380a63 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:23.723231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7edf89-99c1-41e7-8b11-15df96380a63 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:23.727997 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e451-c34e-488d-820f-1dcd556d26fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:23.729247 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e451-c34e-488d-820f-1dcd556d26fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.729526 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e451-c34e-488d-820f-1dcd556d26fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.729803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e451-c34e-488d-820f-1dcd556d26fa admin admin] PATH_INFO: `/v3/projects/08d6f8a545bd415898163a4e3bc7f741/users/b9ab89f07da24901b2c20f6a37e2348c/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.744434 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256e451-c34e-488d-820f-1dcd556d26fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d6f8a545bd415898163a4e3bc7f741, user_id=b9ab89f07da24901b2c20f6a37e2348c, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:23.747144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256e451-c34e-488d-820f-1dcd556d26fa admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:23.855872 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1403/2795] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:23 2022] PUT /identity/v3/projects/08d6f8a545bd415898163a4e3bc7f741/users/b9ab89f07da24901b2c20f6a37e2348c/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:23.866189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d63eb-02c4-44d1-a511-e06ed38878be None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:23.866492 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d63eb-02c4-44d1-a511-e06ed38878be None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:23.866787 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d63eb-02c4-44d1-a511-e06ed38878be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:23.894568 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ef2d63eb-02c4-44d1-a511-e06ed38878be None None] MFA Rules not processed for user `b9ab89f07da24901b2c20f6a37e2348c`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:23.897047 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ef2d63eb-02c4-44d1-a511-e06ed38878be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:23.940432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:23.959774 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1393/2796] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:23 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:23.964729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e451-c34e-488d-820f-1dcd556d26fa admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:24.028165 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e451-c34e-488d-820f-1dcd556d26fa admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:24.032847 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea30bc-b510-4ce9-9cae-a531ae78e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:24.033456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea30bc-b510-4ce9-9cae-a531ae78e409 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:24.033764 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea30bc-b510-4ce9-9cae-a531ae78e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:24.034039 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea30bc-b510-4ce9-9cae-a531ae78e409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:24.034697 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea30bc-b510-4ce9-9cae-a531ae78e409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:24.036577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea30bc-b510-4ce9-9cae-a531ae78e409 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:24.115799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:24.121850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1404/2797] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:23 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:24.127786 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d63eb-02c4-44d1-a511-e06ed38878be None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:24.137105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d63eb-02c4-44d1-a511-e06ed38878be None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:24.192771 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2d7a5-a11c-4cc4-bf34-d332be4930da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:24.193367 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d7a5-a11c-4cc4-bf34-d332be4930da admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:24.193637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d7a5-a11c-4cc4-bf34-d332be4930da admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:24.193905 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d7a5-a11c-4cc4-bf34-d332be4930da admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:24.194560 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2d7a5-a11c-4cc4-bf34-d332be4930da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:24.196454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2d7a5-a11c-4cc4-bf34-d332be4930da admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:24.309435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1394/2798] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:24 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:24.313348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea30bc-b510-4ce9-9cae-a531ae78e409 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:24.324424 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea30bc-b510-4ce9-9cae-a531ae78e409 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:24.329035 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd99d-d397-4556-acbf-b60f4e8fd902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:24.329623 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd99d-d397-4556-acbf-b60f4e8fd902 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:24.329898 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd99d-d397-4556-acbf-b60f4e8fd902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:24.330166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd99d-d397-4556-acbf-b60f4e8fd902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:24.330836 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd99d-d397-4556-acbf-b60f4e8fd902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:24.332419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd99d-d397-4556-acbf-b60f4e8fd902 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:24.343552 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1405/2799] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:24.347825 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2d7a5-a11c-4cc4-bf34-d332be4930da admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:24.357833 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2d7a5-a11c-4cc4-bf34-d332be4930da admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:24.362382 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375f280-7b8c-4981-88bb-ee4a83dd1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:24.363042 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375f280-7b8c-4981-88bb-ee4a83dd1690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:24.363316 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375f280-7b8c-4981-88bb-ee4a83dd1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:24.363585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375f280-7b8c-4981-88bb-ee4a83dd1690 admin admin] PATH_INFO: `/v3/projects/1dff93cabca24b33822aeff406efec72/users/a0b46f4da57d4f1782395f4c39300398/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:24.377746 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375f280-7b8c-4981-88bb-ee4a83dd1690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dff93cabca24b33822aeff406efec72, user_id=a0b46f4da57d4f1782395f4c39300398, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:24.380403 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375f280-7b8c-4981-88bb-ee4a83dd1690 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:24.488370 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1395/2800] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:24 2022] PUT /identity/v3/projects/1dff93cabca24b33822aeff406efec72/users/a0b46f4da57d4f1782395f4c39300398/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:54:24.492237 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd99d-d397-4556-acbf-b60f4e8fd902 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:24.502835 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd99d-d397-4556-acbf-b60f4e8fd902 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:24.561107 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16c99d-5a0f-4f83-84df-5a4f0cbb8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:24.561643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16c99d-5a0f-4f83-84df-5a4f0cbb8d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:24.561962 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16c99d-5a0f-4f83-84df-5a4f0cbb8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:24.562292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16c99d-5a0f-4f83-84df-5a4f0cbb8d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:24.562974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16c99d-5a0f-4f83-84df-5a4f0cbb8d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:24.564561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16c99d-5a0f-4f83-84df-5a4f0cbb8d82 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:24.575717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1406/2801] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:24.579852 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375f280-7b8c-4981-88bb-ee4a83dd1690 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:24.590409 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375f280-7b8c-4981-88bb-ee4a83dd1690 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:24.595313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:24.596028 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:24.596317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:24.596574 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] PATH_INFO: `/v3/projects/1dff93cabca24b33822aeff406efec72/users/a0b46f4da57d4f1782395f4c39300398/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:24.598609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dff93cabca24b33822aeff406efec72, user_id=a0b46f4da57d4f1782395f4c39300398, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:24.601223 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:24.612713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1396/2802] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:24 2022] PUT /identity/v3/projects/1dff93cabca24b33822aeff406efec72/users/a0b46f4da57d4f1782395f4c39300398/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:24.624789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f03c-cc4d-4ad3-bf60-fc77f805bf56 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:24.624988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f03c-cc4d-4ad3-bf60-fc77f805bf56 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:24.625287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f03c-cc4d-4ad3-bf60-fc77f805bf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:24.654960 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1e72f03c-cc4d-4ad3-bf60-fc77f805bf56 None None] MFA Rules not processed for user `a0b46f4da57d4f1782395f4c39300398`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:24.663921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1e72f03c-cc4d-4ad3-bf60-fc77f805bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:24.727803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1407/2803] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:24.738713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:24.740602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:24.803782 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3212-3416-49a9-8d1a-e2a87660e2d5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:24.808092 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba363318-d3f8-44eb-86ae-f05799bc0757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:24.808688 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba363318-d3f8-44eb-86ae-f05799bc0757 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:24.808962 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba363318-d3f8-44eb-86ae-f05799bc0757 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:24.809231 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba363318-d3f8-44eb-86ae-f05799bc0757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:24.818059 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba363318-d3f8-44eb-86ae-f05799bc0757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:24.819594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba363318-d3f8-44eb-86ae-f05799bc0757 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:24.828822 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1397/2804] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:24 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:24.972450 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72f03c-cc4d-4ad3-bf60-fc77f805bf56 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:25.034262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72f03c-cc4d-4ad3-bf60-fc77f805bf56 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:25.039357 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:25.039989 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:25.040269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:25.040537 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] PATH_INFO: `/v3/users/b9ab89f07da24901b2c20f6a37e2348c` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:25.042146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ab89f07da24901b2c20f6a37e2348c)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:25.044108 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:25.056709 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:25.216851 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ab89f07da24901b2c20f6a37e2348c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:25.224140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ab89f07da24901b2c20f6a37e2348c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:25.300155 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ab89f07da24901b2c20f6a37e2348c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:25.300766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ab89f07da24901b2c20f6a37e2348c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:25.313065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ab89f07da24901b2c20f6a37e2348c'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:25.319131 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1408/2805] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:24 2022] DELETE /identity/v3/users/b9ab89f07da24901b2c20f6a37e2348c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:25.323781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5276d-2f42-4776-baac-58d33490883f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:25.324191 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5276d-2f42-4776-baac-58d33490883f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:25.325707 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5276d-2f42-4776-baac-58d33490883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:25.343954 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-aab5276d-2f42-4776-baac-58d33490883f None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:25.345197 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aab5276d-2f42-4776-baac-58d33490883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:25.382650 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:25.403396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1398/2806] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:54:25.413134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:25.414559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:25.471584 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258d21d-5568-4fef-9416-c649bcc2191d admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:25.475123 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:25.475717 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:25.475993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:25.476262 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:25.485692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:25.487122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:25.496328 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1409/2807] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:25.836788 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5276d-2f42-4776-baac-58d33490883f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:25.838232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aab5276d-2f42-4776-baac-58d33490883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:25.895328 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5276d-2f42-4776-baac-58d33490883f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:25.898848 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:25.899451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:25.899717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:25.899983 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:25.901704 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:25.917037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:25.918647 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:25.946210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e4e3-955d-4d5c-9212-f1ddafc0ce02 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:25.954449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:25.963559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:25.963559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:25.963559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] PATH_INFO: `/v3/projects/08d6f8a545bd415898163a4e3bc7f741` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:25.963559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d6f8a545bd415898163a4e3bc7f741)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:25.963559 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:25.976089 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:25.977562 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:25.987395 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1399/2808] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:26.113318 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d6f8a545bd415898163a4e3bc7f741', 'request_id': 'req-6b166cbe-e7b5-4915-a2aa-922651646aa7'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.119082 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d6f8a545bd415898163a4e3bc7f741', 'request_id': 'req-6b166cbe-e7b5-4915-a2aa-922651646aa7'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.125758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d6f8a545bd415898163a4e3bc7f741', 'request_id': 'req-6b166cbe-e7b5-4915-a2aa-922651646aa7'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.207239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] The token cache is being invalidate because project 08d6f8a545bd415898163a4e3bc7f741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:26.207239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.207239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.207239 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1410/2809] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:25 2022] DELETE /identity/v3/projects/08d6f8a545bd415898163a4e3bc7f741 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:54:26.209989 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:26.220595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb7e5-60d8-46e3-b30e-85346e26fb07 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:26.281488 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:26.282034 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:26.282304 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:26.282602 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] PATH_INFO: `/v3/users/a0b46f4da57d4f1782395f4c39300398` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:26.283706 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b46f4da57d4f1782395f4c39300398)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:26.285603 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:26.462735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:26.472124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b46f4da57d4f1782395f4c39300398'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.555732 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b46f4da57d4f1782395f4c39300398'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.563703 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b46f4da57d4f1782395f4c39300398'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.576020 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b46f4da57d4f1782395f4c39300398'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.576821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-30219f56-fe5c-4e8f-9624-afab86dc8da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b46f4da57d4f1782395f4c39300398'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:26.582917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1400/2810] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:26 2022] DELETE /identity/v3/users/a0b46f4da57d4f1782395f4c39300398 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:27.071037 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:27.073187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:27.086042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b166cbe-e7b5-4915-a2aa-922651646aa7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:27.099593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:27.144549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:27.145371 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.145646 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.145916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] PATH_INFO: `/v3/projects/1dff93cabca24b33822aeff406efec72` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.147174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dff93cabca24b33822aeff406efec72)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:27.149113 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:27.261500 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dff93cabca24b33822aeff406efec72', 'request_id': 'req-a52c6f54-2ade-4f0e-a325-304583a08ed8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:27.267127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dff93cabca24b33822aeff406efec72', 'request_id': 'req-a52c6f54-2ade-4f0e-a325-304583a08ed8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:27.273341 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dff93cabca24b33822aeff406efec72', 'request_id': 'req-a52c6f54-2ade-4f0e-a325-304583a08ed8'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:27.340701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] The token cache is being invalidate because project 1dff93cabca24b33822aeff406efec72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:27.340895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:27.341564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-a52c6f54-2ade-4f0e-a325-304583a08ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:27.343421 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1411/2811] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:27 2022] DELETE /identity/v3/projects/1dff93cabca24b33822aeff406efec72 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:27.348541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2675-32be-46a8-adec-a5eb89cf90e4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.348826 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2675-32be-46a8-adec-a5eb89cf90e4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.349103 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2675-32be-46a8-adec-a5eb89cf90e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.370726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6e1e2675-32be-46a8-adec-a5eb89cf90e4 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:27.372861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6e1e2675-32be-46a8-adec-a5eb89cf90e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:27.432897 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1401/2812] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:27.440840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02305302-a873-4159-a600-77909fb6609d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.441126 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02305302-a873-4159-a600-77909fb6609d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.441400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02305302-a873-4159-a600-77909fb6609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.461460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-02305302-a873-4159-a600-77909fb6609d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:27.462815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-02305302-a873-4159-a600-77909fb6609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:27.470820 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1412/2813] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:27.478934 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2675-32be-46a8-adec-a5eb89cf90e4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:27.489879 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2675-32be-46a8-adec-a5eb89cf90e4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:27.494970 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:27.495605 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.495875 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.496140 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.496783 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:54:27.497077 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:27.498701 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:27.510647 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1402/2814] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:54:27.515603 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02305302-a873-4159-a600-77909fb6609d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:27.525819 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02305302-a873-4159-a600-77909fb6609d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:27.530549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4c64d-8556-4dd0-b38e-5bc81ac272c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:27.531356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c64d-8556-4dd0-b38e-5bc81ac272c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.531633 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c64d-8556-4dd0-b38e-5bc81ac272c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.531903 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c64d-8556-4dd0-b38e-5bc81ac272c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.532520 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4c64d-8556-4dd0-b38e-5bc81ac272c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:27.534403 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4c64d-8556-4dd0-b38e-5bc81ac272c7 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:27.625485 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1413/2815] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:27 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:27.629757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:27.640735 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061352-4edc-4c03-b736-df7efdb38c58 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:27.695709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e63e-1c51-4a35-b4ca-1368c2329580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:27.696302 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e63e-1c51-4a35-b4ca-1368c2329580 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.696578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e63e-1c51-4a35-b4ca-1368c2329580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.696844 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e63e-1c51-4a35-b4ca-1368c2329580 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.697462 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38e63e-1c51-4a35-b4ca-1368c2329580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:27.699944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38e63e-1c51-4a35-b4ca-1368c2329580 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:27.800549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1403/2816] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:27 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:27.804617 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4c64d-8556-4dd0-b38e-5bc81ac272c7 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:27.815627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4c64d-8556-4dd0-b38e-5bc81ac272c7 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:27.820276 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74754b3-98e6-4971-9e8c-77c926b15dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:27.820869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74754b3-98e6-4971-9e8c-77c926b15dba admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.821146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74754b3-98e6-4971-9e8c-77c926b15dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.821417 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74754b3-98e6-4971-9e8c-77c926b15dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.822057 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74754b3-98e6-4971-9e8c-77c926b15dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:27.823714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74754b3-98e6-4971-9e8c-77c926b15dba admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:27.833598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1414/2817] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:27.837589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e63e-1c51-4a35-b4ca-1368c2329580 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:27.848481 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e63e-1c51-4a35-b4ca-1368c2329580 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:27.853624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ee29d-e3e4-4353-a58e-89fa3c3fff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:27.854979 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ee29d-e3e4-4353-a58e-89fa3c3fff07 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.855261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ee29d-e3e4-4353-a58e-89fa3c3fff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.855537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ee29d-e3e4-4353-a58e-89fa3c3fff07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.856185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ee29d-e3e4-4353-a58e-89fa3c3fff07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:27.857781 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ee29d-e3e4-4353-a58e-89fa3c3fff07 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:27.868779 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1404/2818] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:27.873729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74754b3-98e6-4971-9e8c-77c926b15dba admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:27.883973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74754b3-98e6-4971-9e8c-77c926b15dba admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:27.888653 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceee870-2392-4692-8403-51a38413ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:27.889295 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee870-2392-4692-8403-51a38413ec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.889572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee870-2392-4692-8403-51a38413ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.889841 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee870-2392-4692-8403-51a38413ec93 admin admin] PATH_INFO: `/v3/projects/0ddeb7c919a34120809579fdaa2a5743/users/29f6b8aefcaf408981c5ce429605707c/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:27.904398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceee870-2392-4692-8403-51a38413ec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddeb7c919a34120809579fdaa2a5743, user_id=29f6b8aefcaf408981c5ce429605707c, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:27.907166 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceee870-2392-4692-8403-51a38413ec93 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:27.963840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1415/2819] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:27 2022] PUT /identity/v3/projects/0ddeb7c919a34120809579fdaa2a5743/users/29f6b8aefcaf408981c5ce429605707c/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:27.973967 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea7f2-77d0-4f25-b5c6-263ef25ed56d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:27.974245 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea7f2-77d0-4f25-b5c6-263ef25ed56d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:27.974540 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea7f2-77d0-4f25-b5c6-263ef25ed56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.007666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f5aea7f2-77d0-4f25-b5c6-263ef25ed56d None None] MFA Rules not processed for user `29f6b8aefcaf408981c5ce429605707c`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:28.021721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f5aea7f2-77d0-4f25-b5c6-263ef25ed56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:28.021721 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:28.079902 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1405/2820] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:28.084204 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceee870-2392-4692-8403-51a38413ec93 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:28.134900 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:28.156026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceee870-2392-4692-8403-51a38413ec93 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:28.161007 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d21f05-58c7-4fd4-ab8d-0077ab8a91cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:28.161605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d21f05-58c7-4fd4-ab8d-0077ab8a91cb admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:28.161881 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d21f05-58c7-4fd4-ab8d-0077ab8a91cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:28.162146 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d21f05-58c7-4fd4-ab8d-0077ab8a91cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.162808 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d21f05-58c7-4fd4-ab8d-0077ab8a91cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:28.164725 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d21f05-58c7-4fd4-ab8d-0077ab8a91cb admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:28.226498 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1416/2821] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:28 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:28.230253 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aea7f2-77d0-4f25-b5c6-263ef25ed56d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:28.241137 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aea7f2-77d0-4f25-b5c6-263ef25ed56d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:28.298620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0746d89-64cc-456f-98cd-c4b9186abb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:28.299224 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0746d89-64cc-456f-98cd-c4b9186abb8a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:28.299497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0746d89-64cc-456f-98cd-c4b9186abb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:28.299764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0746d89-64cc-456f-98cd-c4b9186abb8a admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.300449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0746d89-64cc-456f-98cd-c4b9186abb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:28.302369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0746d89-64cc-456f-98cd-c4b9186abb8a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:28.414777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1406/2822] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:28 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:28.419321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d21f05-58c7-4fd4-ab8d-0077ab8a91cb admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:28.430179 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d21f05-58c7-4fd4-ab8d-0077ab8a91cb admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:28.435326 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d54fe-447b-4d9c-9f71-24c92c2baafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:28.435965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d54fe-447b-4d9c-9f71-24c92c2baafe admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:28.436243 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d54fe-447b-4d9c-9f71-24c92c2baafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:28.436513 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d54fe-447b-4d9c-9f71-24c92c2baafe admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.437154 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d54fe-447b-4d9c-9f71-24c92c2baafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:28.438829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d54fe-447b-4d9c-9f71-24c92c2baafe admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:28.448803 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1417/2823] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:28.453105 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0746d89-64cc-456f-98cd-c4b9186abb8a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:28.464001 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0746d89-64cc-456f-98cd-c4b9186abb8a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:28.468947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061c3c-b3e4-4b8a-9f9f-61a191f96a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:28.469607 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061c3c-b3e4-4b8a-9f9f-61a191f96a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:28.469883 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061c3c-b3e4-4b8a-9f9f-61a191f96a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:28.470211 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061c3c-b3e4-4b8a-9f9f-61a191f96a3e admin admin] PATH_INFO: `/v3/projects/8682674fe82a4d8389f3b412d3d9526b/users/453b55c92add4671aaa2cadf0dfebb2f/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.487158 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35061c3c-b3e4-4b8a-9f9f-61a191f96a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8682674fe82a4d8389f3b412d3d9526b, user_id=453b55c92add4671aaa2cadf0dfebb2f, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:28.490303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35061c3c-b3e4-4b8a-9f9f-61a191f96a3e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:28.566767 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1407/2824] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:28 2022] PUT /identity/v3/projects/8682674fe82a4d8389f3b412d3d9526b/users/453b55c92add4671aaa2cadf0dfebb2f/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:28.570733 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d54fe-447b-4d9c-9f71-24c92c2baafe admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:28.581456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d54fe-447b-4d9c-9f71-24c92c2baafe admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:28.643662 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c74b81-54a2-4956-ac12-5886eb96182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:28.644273 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74b81-54a2-4956-ac12-5886eb96182c admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:28.644551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74b81-54a2-4956-ac12-5886eb96182c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:28.645980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c74b81-54a2-4956-ac12-5886eb96182c admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.645980 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c74b81-54a2-4956-ac12-5886eb96182c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:28.647181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c74b81-54a2-4956-ac12-5886eb96182c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:28.657735 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1418/2825] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:54:28.662007 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061c3c-b3e4-4b8a-9f9f-61a191f96a3e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:28.674680 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061c3c-b3e4-4b8a-9f9f-61a191f96a3e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:28.677366 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:28.678024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:28.678303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:28.678613 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] PATH_INFO: `/v3/projects/8682674fe82a4d8389f3b412d3d9526b/users/453b55c92add4671aaa2cadf0dfebb2f/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.680665 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8682674fe82a4d8389f3b412d3d9526b, user_id=453b55c92add4671aaa2cadf0dfebb2f, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:28.683325 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:28.698219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1408/2826] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:28 2022] PUT /identity/v3/projects/8682674fe82a4d8389f3b412d3d9526b/users/453b55c92add4671aaa2cadf0dfebb2f/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:28.764248 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30f7b-f289-4fcf-9241-71bb5383615b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:28.764553 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30f7b-f289-4fcf-9241-71bb5383615b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:28.764825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30f7b-f289-4fcf-9241-71bb5383615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.792677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-1ac30f7b-f289-4fcf-9241-71bb5383615b None None] MFA Rules not processed for user `453b55c92add4671aaa2cadf0dfebb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:28.793925 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-1ac30f7b-f289-4fcf-9241-71bb5383615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:28.862511 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1419/2827] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:28.873918 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:28.875713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:28.938491 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146144a7-38ce-4820-8046-54ab5fbfe2bc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:28.942267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:28.942933 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:28.943265 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:28.943571 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:28.957233 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:29.002295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:29.003810 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:29.015921 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1409/2828] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:37.424329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac30f7b-f289-4fcf-9241-71bb5383615b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:37.434411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac30f7b-f289-4fcf-9241-71bb5383615b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:37.438054 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:37.438718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:37.439025 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:37.440321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:37.449673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:37.451192 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:37.460731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1420/2829] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:39.063944 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=21 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:46.083913 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:46.085436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:46.158087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5b03c-442f-45d9-94b1-679138489de6 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:46.163712 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d6165eeb524d18aa963f3dcaf84dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:46.166988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:46.166988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:46.166988 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:46.167381 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:46.179588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:46.181159 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:46.192112 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1410/2830] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:54:47.456381 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:56.187209 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=34 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:56.800547 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:56.802002 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:56.865225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fed7fd-3c7e-4f1f-b4fc-9afbcec837f5 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:56.869760 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:56.870370 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:56.870685 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:56.870943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] PATH_INFO: `/v3/users/0de8dfbec84b4ad3befa73c1b7ba03f5` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:56.872048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de8dfbec84b4ad3befa73c1b7ba03f5)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:56.873949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:57.024472 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de8dfbec84b4ad3befa73c1b7ba03f5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.031911 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de8dfbec84b4ad3befa73c1b7ba03f5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.085674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de8dfbec84b4ad3befa73c1b7ba03f5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.086297 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de8dfbec84b4ad3befa73c1b7ba03f5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.099613 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de8dfbec84b4ad3befa73c1b7ba03f5'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.105677 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1421/2831] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:56 2022] DELETE /identity/v3/users/0de8dfbec84b4ad3befa73c1b7ba03f5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:57.395860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:57.406332 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858134-6db8-49e8-8fb6-c3f13068a9b7 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:57.464604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:57.465260 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:57.465539 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:57.465805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] PATH_INFO: `/v3/projects/80bae457273d47b99c198626f7e95424` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:57.466942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80bae457273d47b99c198626f7e95424)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:57.468908 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:57.597549 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80bae457273d47b99c198626f7e95424', 'request_id': 'req-eaa4f782-6481-4cd0-9b52-027999a6f8f7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.682682 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80bae457273d47b99c198626f7e95424', 'request_id': 'req-eaa4f782-6481-4cd0-9b52-027999a6f8f7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.689295 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80bae457273d47b99c198626f7e95424', 'request_id': 'req-eaa4f782-6481-4cd0-9b52-027999a6f8f7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.700213 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] The token cache is being invalidate because project 80bae457273d47b99c198626f7e95424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:57.700496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.701129 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.702626 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1411/2832] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:57 2022] DELETE /identity/v3/projects/80bae457273d47b99c198626f7e95424 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:57.706619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:57.708066 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:57.721198 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce776c-c1f3-4885-9aee-236331bef23a admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:57.776529 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:57.777151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:57.777431 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:57.777701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] PATH_INFO: `/v3/users/2d7fe777de5d437a9d123bda09f42b26` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:57.778869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7fe777de5d437a9d123bda09f42b26)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:57.780786 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:57.802061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:57.973102 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7fe777de5d437a9d123bda09f42b26'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:57.980496 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7fe777de5d437a9d123bda09f42b26'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.062348 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7fe777de5d437a9d123bda09f42b26'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.063076 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7fe777de5d437a9d123bda09f42b26'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.075333 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-5466b73d-c589-4bcc-9876-1738af88f327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7fe777de5d437a9d123bda09f42b26'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.081208 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1422/2833] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:54:57 2022] DELETE /identity/v3/users/2d7fe777de5d437a9d123bda09f42b26 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:58.346388 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:58.347898 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:58.362664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4f782-6481-4cd0-9b52-027999a6f8f7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:58.433910 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:58.434580 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:58.434861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:58.435132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] PATH_INFO: `/v3/projects/63a0705292bb481aabe1c9c7c973a120` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:58.436354 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a0705292bb481aabe1c9c7c973a120)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:58.438303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:58.550842 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:58.562616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a0705292bb481aabe1c9c7c973a120', 'request_id': 'req-c19f3a87-5121-468f-8b0a-f144e1db6f94'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.673437 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a0705292bb481aabe1c9c7c973a120', 'request_id': 'req-c19f3a87-5121-468f-8b0a-f144e1db6f94'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.679939 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a0705292bb481aabe1c9c7c973a120', 'request_id': 'req-c19f3a87-5121-468f-8b0a-f144e1db6f94'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.691816 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] The token cache is being invalidate because project 63a0705292bb481aabe1c9c7c973a120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:54:58.692104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.692792 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c19f3a87-5121-468f-8b0a-f144e1db6f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:54:58.694585 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1412/2834] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:54:58 2022] DELETE /identity/v3/projects/63a0705292bb481aabe1c9c7c973a120 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:54:58.700098 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b283-e702-4641-b24f-aab5c3407405 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:58.700386 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b283-e702-4641-b24f-aab5c3407405 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:58.700730 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b283-e702-4641-b24f-aab5c3407405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:58.720568 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-9a24b283-e702-4641-b24f-aab5c3407405 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:58.721799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-9a24b283-e702-4641-b24f-aab5c3407405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:58.781231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1423/2835] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:58.788931 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6eeed-51ab-4c6d-9980-8dec86d94a69 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:58.789236 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6eeed-51ab-4c6d-9980-8dec86d94a69 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:58.789505 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6eeed-51ab-4c6d-9980-8dec86d94a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:58.809168 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fba6eeed-51ab-4c6d-9980-8dec86d94a69 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:58.810384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fba6eeed-51ab-4c6d-9980-8dec86d94a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:58.818104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1413/2836] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:54:58.822880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24b283-e702-4641-b24f-aab5c3407405 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:58.832428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24b283-e702-4641-b24f-aab5c3407405 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:58.836991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:58.838181 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:58.838456 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:58.838752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:58.839400 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:54:58.839701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:58.841286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:58.857993 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1424/2837] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 08:54:58.862281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6eeed-51ab-4c6d-9980-8dec86d94a69 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:58.872132 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6eeed-51ab-4c6d-9980-8dec86d94a69 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:58.876776 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73829f9-5a6b-4f48-91d1-d0de500e80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:58.877362 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73829f9-5a6b-4f48-91d1-d0de500e80a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:58.877639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73829f9-5a6b-4f48-91d1-d0de500e80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:58.877907 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73829f9-5a6b-4f48-91d1-d0de500e80a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:58.878561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73829f9-5a6b-4f48-91d1-d0de500e80a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:58.880447 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73829f9-5a6b-4f48-91d1-d0de500e80a4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:58.972812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1414/2838] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:54:58 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:58.976815 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:58.986769 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9567a3-ec78-4dae-88a0-a31ff53d8aa8 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:59.045409 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e92868-821f-4fea-9648-ae376be7f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:59.046335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92868-821f-4fea-9648-ae376be7f9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:59.046968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92868-821f-4fea-9648-ae376be7f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:59.047242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92868-821f-4fea-9648-ae376be7f9ca admin admin] PATH_INFO: `/v3/users` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:59.047861 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e92868-821f-4fea-9648-ae376be7f9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:59.050026 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e92868-821f-4fea-9648-ae376be7f9ca admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:59.119933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1425/2839] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:54:58 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:54:59.124087 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73829f9-5a6b-4f48-91d1-d0de500e80a4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:59.135040 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73829f9-5a6b-4f48-91d1-d0de500e80a4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:59.141313 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10677-3620-459f-bdf4-262451895984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:59.142339 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10677-3620-459f-bdf4-262451895984 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:59.142791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10677-3620-459f-bdf4-262451895984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:59.143067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b10677-3620-459f-bdf4-262451895984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:59.143715 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10677-3620-459f-bdf4-262451895984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:59.145812 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b10677-3620-459f-bdf4-262451895984 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:59.158364 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1415/2840] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:59.162440 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e92868-821f-4fea-9648-ae376be7f9ca admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:59.172801 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e92868-821f-4fea-9648-ae376be7f9ca admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:59.177499 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cea702-df2e-4eed-a825-cae9e04a93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:59.178085 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cea702-df2e-4eed-a825-cae9e04a93b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:59.178359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cea702-df2e-4eed-a825-cae9e04a93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:59.178658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cea702-df2e-4eed-a825-cae9e04a93b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:59.179289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cea702-df2e-4eed-a825-cae9e04a93b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:59.181355 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cea702-df2e-4eed-a825-cae9e04a93b6 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:59.191864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1426/2841] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:54:59.196031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10677-3620-459f-bdf4-262451895984 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:59.206561 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b10677-3620-459f-bdf4-262451895984 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:59.211184 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:59.211821 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:59.212117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:59.212391 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] PATH_INFO: `/v3/projects/0a55e411ec6b452f9e2005a1d75351d8/users/c7ba5185b97d4b5c8318677f61b44ab0/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:59.226594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a55e411ec6b452f9e2005a1d75351d8, user_id=c7ba5185b97d4b5c8318677f61b44ab0, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:59.229729 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:59.291320 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1416/2842] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:54:59 2022] PUT /identity/v3/projects/0a55e411ec6b452f9e2005a1d75351d8/users/c7ba5185b97d4b5c8318677f61b44ab0/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:54:59.301490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d829-0242-4f3b-8e11-ca9c24d22d40 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:59.301766 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d829-0242-4f3b-8e11-ca9c24d22d40 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:59.302033 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d829-0242-4f3b-8e11-ca9c24d22d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:59.310691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:59.329250 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-0a81d829-0242-4f3b-8e11-ca9c24d22d40 None None] MFA Rules not processed for user `c7ba5185b97d4b5c8318677f61b44ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:54:59.330444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0a81d829-0242-4f3b-8e11-ca9c24d22d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:59.396480 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1427/2843] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 08:54:59.407489 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:54:59.409210 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:54:59.470936 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae29e-969e-47cf-866a-d391332d5db2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:54:59.474834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:54:59.475448 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:54:59.479314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:54:59.479314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:54:59.487982 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:54:59.489507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:54:59.499909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1417/2844] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:09.431971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=30 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:09.494628 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:13.751561 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81d829-0242-4f3b-8e11-ca9c24d22d40 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:13.753048 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0a81d829-0242-4f3b-8e11-ca9c24d22d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:13.809882 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81d829-0242-4f3b-8e11-ca9c24d22d40 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:13.813361 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:13.813951 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:13.814313 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:13.814732 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:13.816471 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:13.889402 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:13.891067 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:13.901501 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1428/2845] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:17.351951 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:17.353444 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:17.434014 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c261-8713-40ad-8ef2-9399997eeaa9 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:17.438968 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:17.439563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:17.439835 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:17.440104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:17.441778 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:17.452804 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:17.454361 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:17.464051 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1418/2846] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:21.240147 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:21.241635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:21.254889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910fdb-2541-4783-92a1-87134bbb114c service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:21.259772 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:21.260401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:21.260679 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:21.260948 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] PATH_INFO: `/v3/users/f1c7a90e90e5411f92eddd180ef9e27d` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:21.275140 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c7a90e90e5411f92eddd180ef9e27d)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:21.277110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:21.460512 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:21.461920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:21.475720 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08dd5-b5c1-4341-ba4c-82ec2637a150 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:21.481977 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:21.482639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:21.482920 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:21.483189 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] PATH_INFO: `/v3/users/29f6b8aefcaf408981c5ce429605707c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:21.485482 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f6b8aefcaf408981c5ce429605707c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:21.487541 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:21.490823 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c7a90e90e5411f92eddd180ef9e27d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.497949 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c7a90e90e5411f92eddd180ef9e27d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.579411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c7a90e90e5411f92eddd180ef9e27d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.580042 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c7a90e90e5411f92eddd180ef9e27d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.594356 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-277a3ec1-427d-4c72-8be4-9beee0ca6ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c7a90e90e5411f92eddd180ef9e27d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.600557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1429/2847] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:55:21 2022] DELETE /identity/v3/users/f1c7a90e90e5411f92eddd180ef9e27d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:21.705496 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f6b8aefcaf408981c5ce429605707c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.770408 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f6b8aefcaf408981c5ce429605707c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.778657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f6b8aefcaf408981c5ce429605707c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.790169 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f6b8aefcaf408981c5ce429605707c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.790834 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f6b8aefcaf408981c5ce429605707c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:21.796609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1419/2848] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:55:21 2022] DELETE /identity/v3/users/29f6b8aefcaf408981c5ce429605707c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:55:21.800996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722262f-1356-49e3-8367-6c9fb0fc2da7 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:21.801459 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722262f-1356-49e3-8367-6c9fb0fc2da7 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:21.801743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722262f-1356-49e3-8367-6c9fb0fc2da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:21.820701 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-0722262f-1356-49e3-8367-6c9fb0fc2da7 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:21.821899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0722262f-1356-49e3-8367-6c9fb0fc2da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:21.827708 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:21.862071 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:21.863604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:21.889736 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1430/2849] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:21.901399 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722262f-1356-49e3-8367-6c9fb0fc2da7 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:21.903366 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-0722262f-1356-49e3-8367-6c9fb0fc2da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:21.961858 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf9365-ab55-4887-bef4-001edf6ab1a6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:21.967950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:21.970498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:21.970498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:21.970498 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] PATH_INFO: `/v3/projects/b3230d51d63a4f9a9d47624c553242f4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:21.972406 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:21.973220 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722262f-1356-49e3-8367-6c9fb0fc2da7 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:21.977020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2710-e0b9-41f7-bfda-281f4e63a578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:21.977627 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2710-e0b9-41f7-bfda-281f4e63a578 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:21.977899 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2710-e0b9-41f7-bfda-281f4e63a578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:21.978238 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2710-e0b9-41f7-bfda-281f4e63a578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:21.982700 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3230d51d63a4f9a9d47624c553242f4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:21.984876 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:21.988274 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda2710-e0b9-41f7-bfda-281f4e63a578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:21.989731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda2710-e0b9-41f7-bfda-281f4e63a578 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:22.000225 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1431/2850] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:22.108872 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3230d51d63a4f9a9d47624c553242f4', 'request_id': 'req-37f3ec83-a807-4262-832b-cd8320405491'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.203025 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3230d51d63a4f9a9d47624c553242f4', 'request_id': 'req-37f3ec83-a807-4262-832b-cd8320405491'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.211392 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3230d51d63a4f9a9d47624c553242f4', 'request_id': 'req-37f3ec83-a807-4262-832b-cd8320405491'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.222232 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] The token cache is being invalidate because project b3230d51d63a4f9a9d47624c553242f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:55:22.222533 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.223198 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.227487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1420/2851] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:55:21 2022] DELETE /identity/v3/projects/b3230d51d63a4f9a9d47624c553242f4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:55:22.229020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2710-e0b9-41f7-bfda-281f4e63a578 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:22.240693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2710-e0b9-41f7-bfda-281f4e63a578 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:22.299446 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:22.300104 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:22.300377 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:22.300843 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] PATH_INFO: `/v3/users/6281762ed6bb4a34911ec6fa22099239` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:22.314458 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6281762ed6bb4a34911ec6fa22099239)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:22.316457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:22.451627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:22.456278 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:22.466171 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3ec83-a807-4262-832b-cd8320405491 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:22.471170 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:22.471885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:22.472222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:22.472593 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] PATH_INFO: `/v3/projects/0ddeb7c919a34120809579fdaa2a5743` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:22.473791 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddeb7c919a34120809579fdaa2a5743)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:22.475859 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:22.588167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:22.589713 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6281762ed6bb4a34911ec6fa22099239'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.596849 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6281762ed6bb4a34911ec6fa22099239'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.647801 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddeb7c919a34120809579fdaa2a5743', 'request_id': 'req-4c9c158f-62ac-4dd2-a7bb-d541792ff816'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.739335 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6281762ed6bb4a34911ec6fa22099239'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.740011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6281762ed6bb4a34911ec6fa22099239'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.753101 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6281762ed6bb4a34911ec6fa22099239'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.758943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1432/2852] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:55:22 2022] DELETE /identity/v3/users/6281762ed6bb4a34911ec6fa22099239 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:22.796238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddeb7c919a34120809579fdaa2a5743', 'request_id': 'req-4c9c158f-62ac-4dd2-a7bb-d541792ff816'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.803418 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddeb7c919a34120809579fdaa2a5743', 'request_id': 'req-4c9c158f-62ac-4dd2-a7bb-d541792ff816'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.814718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] The token cache is being invalidate because project 0ddeb7c919a34120809579fdaa2a5743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:55:22.815005 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.815669 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:22.817342 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1421/2853] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:55:22 2022] DELETE /identity/v3/projects/0ddeb7c919a34120809579fdaa2a5743 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:55:22.821267 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:22.822734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:22.889093 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fece222-89b3-4e73-9eb0-146437de2b1e admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:22.893902 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:22.894564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:22.894844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:22.895118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] PATH_INFO: `/v3/users/453b55c92add4671aaa2cadf0dfebb2f` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:22.896258 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=453b55c92add4671aaa2cadf0dfebb2f)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:22.898301 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:23.022985 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:23.028277 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:23.087814 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453b55c92add4671aaa2cadf0dfebb2f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.091513 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c158f-62ac-4dd2-a7bb-d541792ff816 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:23.095917 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453b55c92add4671aaa2cadf0dfebb2f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.096126 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:23.096963 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:23.097096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:23.097309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] PATH_INFO: `/v3/projects/44202d5e67bb4ac091570ad8a92b56df` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:23.106455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:23.112327 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=44202d5e67bb4ac091570ad8a92b56df)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:23.112772 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:23.158864 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453b55c92add4671aaa2cadf0dfebb2f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.159483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453b55c92add4671aaa2cadf0dfebb2f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.172729 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453b55c92add4671aaa2cadf0dfebb2f'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.178886 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1433/2854] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:55:22 2022] DELETE /identity/v3/users/453b55c92add4671aaa2cadf0dfebb2f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:23.290770 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44202d5e67bb4ac091570ad8a92b56df', 'request_id': 'req-ada7791d-e2f7-4261-8226-6fb696f814ea'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.376375 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44202d5e67bb4ac091570ad8a92b56df', 'request_id': 'req-ada7791d-e2f7-4261-8226-6fb696f814ea'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.383636 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44202d5e67bb4ac091570ad8a92b56df', 'request_id': 'req-ada7791d-e2f7-4261-8226-6fb696f814ea'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.395657 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] The token cache is being invalidate because project 44202d5e67bb4ac091570ad8a92b56df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:55:23.395947 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.396594 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ada7791d-e2f7-4261-8226-6fb696f814ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.398484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1422/2855] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:55:23 2022] DELETE /identity/v3/projects/44202d5e67bb4ac091570ad8a92b56df => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 08:55:23.666691 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:23.668593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:23.728592 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:23.747775 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11ff70-816e-4f19-a36f-1acec7f50d3c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:23.804551 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:23.805182 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:23.805461 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:23.805731 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] PATH_INFO: `/v3/projects/8682674fe82a4d8389f3b412d3d9526b` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:23.806896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8682674fe82a4d8389f3b412d3d9526b)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:23.808804 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:23.926044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8682674fe82a4d8389f3b412d3d9526b', 'request_id': 'req-14347eaf-d9b0-4c7c-9084-5048cd66710d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.929991 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8682674fe82a4d8389f3b412d3d9526b', 'request_id': 'req-14347eaf-d9b0-4c7c-9084-5048cd66710d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:23.936883 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8682674fe82a4d8389f3b412d3d9526b', 'request_id': 'req-14347eaf-d9b0-4c7c-9084-5048cd66710d'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:24.032361 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] The token cache is being invalidate because project 8682674fe82a4d8389f3b412d3d9526b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:55:24.032660 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:24.033284 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-14347eaf-d9b0-4c7c-9084-5048cd66710d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:24.034798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1434/2856] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:55:23 2022] DELETE /identity/v3/projects/8682674fe82a4d8389f3b412d3d9526b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:24.039557 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda43bb-1034-44d6-85f9-7c7e2907194b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.040031 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda43bb-1034-44d6-85f9-7c7e2907194b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.040604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda43bb-1034-44d6-85f9-7c7e2907194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.061738 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9eda43bb-1034-44d6-85f9-7c7e2907194b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:24.062994 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9eda43bb-1034-44d6-85f9-7c7e2907194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:24.120067 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1423/2857] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:24.130000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f40186-0642-4987-8cc9-fd4aa6730b0d None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.130286 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f40186-0642-4987-8cc9-fd4aa6730b0d None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.130598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f40186-0642-4987-8cc9-fd4aa6730b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.150287 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-50f40186-0642-4987-8cc9-fd4aa6730b0d None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:24.151515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-50f40186-0642-4987-8cc9-fd4aa6730b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:24.159428 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1435/2858] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:24.163604 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda43bb-1034-44d6-85f9-7c7e2907194b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:24.173558 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda43bb-1034-44d6-85f9-7c7e2907194b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:24.178117 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:24.178676 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.178952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.179225 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.179863 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:55:24.180160 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:24.181725 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:24.193646 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1424/2859] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:55:24.197692 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f40186-0642-4987-8cc9-fd4aa6730b0d None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:24.206921 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f40186-0642-4987-8cc9-fd4aa6730b0d None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:24.211582 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459135-b79e-4b31-bb7c-90402d1c1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:24.212170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459135-b79e-4b31-bb7c-90402d1c1f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.212449 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459135-b79e-4b31-bb7c-90402d1c1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.212721 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459135-b79e-4b31-bb7c-90402d1c1f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.213344 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53459135-b79e-4b31-bb7c-90402d1c1f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:24.215305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53459135-b79e-4b31-bb7c-90402d1c1f3f admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:24.323634 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1436/2860] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:55:24 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:55:24.327817 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:24.338108 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc244ee1-5249-440f-a7de-734de8ef2641 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:24.397645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed443b8c-a317-4821-b130-dd78225f122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:24.399185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443b8c-a317-4821-b130-dd78225f122d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.399185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443b8c-a317-4821-b130-dd78225f122d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.399185 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443b8c-a317-4821-b130-dd78225f122d admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.399713 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed443b8c-a317-4821-b130-dd78225f122d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:24.401632 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed443b8c-a317-4821-b130-dd78225f122d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:24.488348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1425/2861] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:55:24 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:55:24.492630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459135-b79e-4b31-bb7c-90402d1c1f3f admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:24.503549 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459135-b79e-4b31-bb7c-90402d1c1f3f admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:24.508289 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d8de-0c86-4752-b44b-6f25591fc56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:24.508887 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d8de-0c86-4752-b44b-6f25591fc56b admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.509167 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d8de-0c86-4752-b44b-6f25591fc56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.509439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d8de-0c86-4752-b44b-6f25591fc56b admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.510439 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6d8de-0c86-4752-b44b-6f25591fc56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:24.512065 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6d8de-0c86-4752-b44b-6f25591fc56b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:24.522703 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1437/2862] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:55:24.526718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed443b8c-a317-4821-b130-dd78225f122d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:24.533797 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:24.537864 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed443b8c-a317-4821-b130-dd78225f122d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:24.542509 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb734b3d-f759-45d3-b944-16a78928495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:24.548484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734b3d-f759-45d3-b944-16a78928495c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.548484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734b3d-f759-45d3-b944-16a78928495c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.548484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb734b3d-f759-45d3-b944-16a78928495c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.548484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb734b3d-f759-45d3-b944-16a78928495c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:24.548484 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb734b3d-f759-45d3-b944-16a78928495c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:24.557318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1426/2863] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:55:24.561850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d8de-0c86-4752-b44b-6f25591fc56b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:24.571972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d8de-0c86-4752-b44b-6f25591fc56b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:24.576789 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bab5b-8022-489b-84f4-036fe3d88235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:24.577605 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bab5b-8022-489b-84f4-036fe3d88235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.577892 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bab5b-8022-489b-84f4-036fe3d88235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.578164 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bab5b-8022-489b-84f4-036fe3d88235 admin admin] PATH_INFO: `/v3/projects/a1c57609602744a3895daff421fd898b/users/8d104ff54e0c4758aeac9568480042f4/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.593742 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bab5b-8022-489b-84f4-036fe3d88235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c57609602744a3895daff421fd898b, user_id=8d104ff54e0c4758aeac9568480042f4, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:24.596488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bab5b-8022-489b-84f4-036fe3d88235 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:24.728317 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1438/2864] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:55:24 2022] PUT /identity/v3/projects/a1c57609602744a3895daff421fd898b/users/8d104ff54e0c4758aeac9568480042f4/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:24.739957 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d8f1-2fb1-42b8-929e-ec67517a73f9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.740244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d8f1-2fb1-42b8-929e-ec67517a73f9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.740519 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d8f1-2fb1-42b8-929e-ec67517a73f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.770289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5363d8f1-2fb1-42b8-929e-ec67517a73f9 None None] MFA Rules not processed for user `8d104ff54e0c4758aeac9568480042f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:24.771518 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5363d8f1-2fb1-42b8-929e-ec67517a73f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:24.834023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1427/2865] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:24.838626 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bab5b-8022-489b-84f4-036fe3d88235 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:24.856411 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:24.900014 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bab5b-8022-489b-84f4-036fe3d88235 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:24.905277 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0df5b7-5e01-4d0d-840f-49ad1beeca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:24.905906 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0df5b7-5e01-4d0d-840f-49ad1beeca8b admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:24.906187 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0df5b7-5e01-4d0d-840f-49ad1beeca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:24.906457 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0df5b7-5e01-4d0d-840f-49ad1beeca8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:24.907095 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0df5b7-5e01-4d0d-840f-49ad1beeca8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:24.908998 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0df5b7-5e01-4d0d-840f-49ad1beeca8b admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:25.066758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1439/2866] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:55:24 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:55:25.070860 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363d8f1-2fb1-42b8-929e-ec67517a73f9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:25.081583 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363d8f1-2fb1-42b8-929e-ec67517a73f9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:25.137359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f4f7-b9b0-4ad6-9609-f6978df94114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:25.140036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f4f7-b9b0-4ad6-9609-f6978df94114 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:25.140425 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f4f7-b9b0-4ad6-9609-f6978df94114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:25.140691 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f4f7-b9b0-4ad6-9609-f6978df94114 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:25.141311 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f4f7-b9b0-4ad6-9609-f6978df94114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:25.143340 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f4f7-b9b0-4ad6-9609-f6978df94114 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:25.267624 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1428/2867] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:55:25 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:55:25.271455 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0df5b7-5e01-4d0d-840f-49ad1beeca8b admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:25.282793 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0df5b7-5e01-4d0d-840f-49ad1beeca8b admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:25.287473 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4928e-dce1-469c-851f-744f877a548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:25.288059 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4928e-dce1-469c-851f-744f877a548c admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:25.288331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4928e-dce1-469c-851f-744f877a548c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:25.288598 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4928e-dce1-469c-851f-744f877a548c admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:25.289231 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4928e-dce1-469c-851f-744f877a548c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:25.290850 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4928e-dce1-469c-851f-744f877a548c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:25.302178 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1440/2868] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 08:55:25.306082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f4f7-b9b0-4ad6-9609-f6978df94114 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:25.316244 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f4f7-b9b0-4ad6-9609-f6978df94114 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:25.323036 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ad19-1680-4988-9283-74f764570bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:25.326584 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ad19-1680-4988-9283-74f764570bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:25.326929 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ad19-1680-4988-9283-74f764570bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:25.327800 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ad19-1680-4988-9283-74f764570bb2 admin admin] PATH_INFO: `/v3/projects/0eb6fa95795549a2aa450f339ad4eabe/users/51eefe4b3f3f4bbeaed77d1a75ceebe1/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:25.343263 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420ad19-1680-4988-9283-74f764570bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb6fa95795549a2aa450f339ad4eabe, user_id=51eefe4b3f3f4bbeaed77d1a75ceebe1, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:25.345867 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420ad19-1680-4988-9283-74f764570bb2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:25.438949 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1429/2869] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:55:25 2022] PUT /identity/v3/projects/0eb6fa95795549a2aa450f339ad4eabe/users/51eefe4b3f3f4bbeaed77d1a75ceebe1/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:25.442896 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4928e-dce1-469c-851f-744f877a548c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:25.453354 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4928e-dce1-469c-851f-744f877a548c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:25.508476 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831eb1b-be32-4524-9736-783a3dc32be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:25.509068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831eb1b-be32-4524-9736-783a3dc32be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:25.509345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831eb1b-be32-4524-9736-783a3dc32be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:25.509614 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831eb1b-be32-4524-9736-783a3dc32be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:25.510249 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831eb1b-be32-4524-9736-783a3dc32be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:25.511937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831eb1b-be32-4524-9736-783a3dc32be3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:25.522919 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1441/2870] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:55:25.526347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ad19-1680-4988-9283-74f764570bb2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:25.537861 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ad19-1680-4988-9283-74f764570bb2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:25.542582 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:25.544709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:25.544709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:25.544709 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] PATH_INFO: `/v3/projects/0eb6fa95795549a2aa450f339ad4eabe/users/51eefe4b3f3f4bbeaed77d1a75ceebe1/roles/45149274288845b0a73e18fbb3394202` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:25.545754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb6fa95795549a2aa450f339ad4eabe, user_id=51eefe4b3f3f4bbeaed77d1a75ceebe1, role_id=45149274288845b0a73e18fbb3394202)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:25.548436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:25.558692 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1430/2871] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:55:25 2022] PUT /identity/v3/projects/0eb6fa95795549a2aa450f339ad4eabe/users/51eefe4b3f3f4bbeaed77d1a75ceebe1/roles/45149274288845b0a73e18fbb3394202 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:25.568857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e92da-584a-45a4-b9d7-380bd7e9cd0e None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:25.569144 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e92da-584a-45a4-b9d7-380bd7e9cd0e None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:25.569414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e92da-584a-45a4-b9d7-380bd7e9cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:25.597690 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-ec5e92da-584a-45a4-b9d7-380bd7e9cd0e None None] MFA Rules not processed for user `51eefe4b3f3f4bbeaed77d1a75ceebe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:25.599110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-ec5e92da-584a-45a4-b9d7-380bd7e9cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:25.665673 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1442/2872] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:25.676309 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:25.678079 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:25.718734 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:25.735639 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc33b4-b1bd-49e4-8eb8-1e123bb83b4d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:25.739315 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6e6e4-70bd-49a7-9bd1-833fe634149b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:25.739955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e6e4-70bd-49a7-9bd1-833fe634149b service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:25.740226 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e6e4-70bd-49a7-9bd1-833fe634149b service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:25.740494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6e6e4-70bd-49a7-9bd1-833fe634149b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:25.749443 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6e6e4-70bd-49a7-9bd1-833fe634149b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:25.750932 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6e6e4-70bd-49a7-9bd1-833fe634149b service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:25.760094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1431/2873] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:25.860714 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e92da-584a-45a4-b9d7-380bd7e9cd0e None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:25.870619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e92da-584a-45a4-b9d7-380bd7e9cd0e None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:25.874877 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda8ecb-5b56-4892-81b2-b914f634d816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:25.875469 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda8ecb-5b56-4892-81b2-b914f634d816 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:25.875745 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda8ecb-5b56-4892-81b2-b914f634d816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:25.876869 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda8ecb-5b56-4892-81b2-b914f634d816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:25.886936 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:25.933893 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda8ecb-5b56-4892-81b2-b914f634d816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:25.935891 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda8ecb-5b56-4892-81b2-b914f634d816 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:25.944635 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1443/2874] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:32.210432 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6e6e4-70bd-49a7-9bd1-833fe634149b service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:32.270869 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6e6e4-70bd-49a7-9bd1-833fe634149b service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:32.275360 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:32.276514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:32.276514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:32.276514 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] PATH_INFO: `/v3/users/8d104ff54e0c4758aeac9568480042f4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:32.277609 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d104ff54e0c4758aeac9568480042f4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:32.280141 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:32.485369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d104ff54e0c4758aeac9568480042f4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:32.592227 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d104ff54e0c4758aeac9568480042f4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:32.599242 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d104ff54e0c4758aeac9568480042f4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:32.611196 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d104ff54e0c4758aeac9568480042f4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:32.611830 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d104ff54e0c4758aeac9568480042f4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:32.617620 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1432/2875] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:55:32 2022] DELETE /identity/v3/users/8d104ff54e0c4758aeac9568480042f4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:32.622684 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ab90-c4e0-4813-8bc6-990734cf479b None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:32.623171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ab90-c4e0-4813-8bc6-990734cf479b None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:32.623285 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ab90-c4e0-4813-8bc6-990734cf479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:32.643856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-bb10ab90-c4e0-4813-8bc6-990734cf479b None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:32.645051 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bb10ab90-c4e0-4813-8bc6-990734cf479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:32.702777 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1444/2876] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:32.712531 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:32.713917 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:32.769857 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb7dd4-d70a-4df1-993e-d131304fb816 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:32.773359 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555546-11cc-4c63-abc0-f3d1046ae4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:32.773950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555546-11cc-4c63-abc0-f3d1046ae4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:32.774279 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555546-11cc-4c63-abc0-f3d1046ae4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:32.774589 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555546-11cc-4c63-abc0-f3d1046ae4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:32.783348 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555546-11cc-4c63-abc0-f3d1046ae4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:32.784764 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555546-11cc-4c63-abc0-f3d1046ae4a1 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:32.789592 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:32.794179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1433/2877] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:33.211426 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10ab90-c4e0-4813-8bc6-990734cf479b None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:33.212825 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-bb10ab90-c4e0-4813-8bc6-990734cf479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:33.227880 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10ab90-c4e0-4813-8bc6-990734cf479b None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:33.241783 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:33.242516 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:33.242798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:33.243096 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] PATH_INFO: `/v3/projects/a1c57609602744a3895daff421fd898b` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:33.244254 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c57609602744a3895daff421fd898b)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:33.246294 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:33.363001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c57609602744a3895daff421fd898b', 'request_id': 'req-f1b94312-295a-4a3e-92d4-11079228e690'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.368593 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c57609602744a3895daff421fd898b', 'request_id': 'req-f1b94312-295a-4a3e-92d4-11079228e690'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.374916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c57609602744a3895daff421fd898b', 'request_id': 'req-f1b94312-295a-4a3e-92d4-11079228e690'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.459856 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] The token cache is being invalidate because project a1c57609602744a3895daff421fd898b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:55:33.460136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.460743 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.462305 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1445/2878] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:55:33 2022] DELETE /identity/v3/projects/a1c57609602744a3895daff421fd898b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:33.466942 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555546-11cc-4c63-abc0-f3d1046ae4a1 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:33.476424 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555546-11cc-4c63-abc0-f3d1046ae4a1 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:33.531809 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:33.532363 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:33.532637 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:33.532906 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] PATH_INFO: `/v3/users/51eefe4b3f3f4bbeaed77d1a75ceebe1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:33.534096 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51eefe4b3f3f4bbeaed77d1a75ceebe1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:33.536035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:33.724693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51eefe4b3f3f4bbeaed77d1a75ceebe1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.798289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51eefe4b3f3f4bbeaed77d1a75ceebe1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.805288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51eefe4b3f3f4bbeaed77d1a75ceebe1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.816923 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51eefe4b3f3f4bbeaed77d1a75ceebe1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.817616 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51eefe4b3f3f4bbeaed77d1a75ceebe1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:33.823559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1434/2879] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:55:33 2022] DELETE /identity/v3/users/51eefe4b3f3f4bbeaed77d1a75ceebe1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:34.244151 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:34.245136 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:34.258761 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b94312-295a-4a3e-92d4-11079228e690 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:34.292292 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:34.319974 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:34.320615 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:34.320897 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:34.321171 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] PATH_INFO: `/v3/projects/0eb6fa95795549a2aa450f339ad4eabe` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:34.322448 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb6fa95795549a2aa450f339ad4eabe)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:34.324425 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:34.451345 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb6fa95795549a2aa450f339ad4eabe', 'request_id': 'req-c539f4c7-e1b9-4015-838b-ebe04207b874'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:34.456751 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb6fa95795549a2aa450f339ad4eabe', 'request_id': 'req-c539f4c7-e1b9-4015-838b-ebe04207b874'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:34.462837 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb6fa95795549a2aa450f339ad4eabe', 'request_id': 'req-c539f4c7-e1b9-4015-838b-ebe04207b874'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:34.543696 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] The token cache is being invalidate because project 0eb6fa95795549a2aa450f339ad4eabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:55:34.543968 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:34.544632 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-c539f4c7-e1b9-4015-838b-ebe04207b874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:34.546636 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1446/2880] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:55:34 2022] DELETE /identity/v3/projects/0eb6fa95795549a2aa450f339ad4eabe => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:35.785894 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:35.787333 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:35.800463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e50dc0-6514-4274-a4e1-3b88c910663a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:35.854347 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:35.854993 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:35.855267 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:35.855538 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] PATH_INFO: `/v3/users/c7ba5185b97d4b5c8318677f61b44ab0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:35.856638 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ba5185b97d4b5c8318677f61b44ab0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:35.859188 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:35.880868 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:36.060599 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ba5185b97d4b5c8318677f61b44ab0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.135238 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ba5185b97d4b5c8318677f61b44ab0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.142955 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ba5185b97d4b5c8318677f61b44ab0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.155358 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ba5185b97d4b5c8318677f61b44ab0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.155998 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ba5185b97d4b5c8318677f61b44ab0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.161846 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1435/2881] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:55:35 2022] DELETE /identity/v3/users/c7ba5185b97d4b5c8318677f61b44ab0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:36.166401 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b9f68-91ec-47ab-aad0-80e6254e6749 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:36.166914 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b9f68-91ec-47ab-aad0-80e6254e6749 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:36.168506 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b9f68-91ec-47ab-aad0-80e6254e6749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:36.185564 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-680b9f68-91ec-47ab-aad0-80e6254e6749 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:36.186796 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-680b9f68-91ec-47ab-aad0-80e6254e6749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:36.249972 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1447/2882] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:36.259630 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:36.261045 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:36.318156 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17120b-2657-4748-8f93-f6c94073aa93 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:36.321838 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8b93e-5642-4d89-a26b-a6137c5a42c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:36.322435 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8b93e-5642-4d89-a26b-a6137c5a42c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:36.322752 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8b93e-5642-4d89-a26b-a6137c5a42c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:36.323021 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8b93e-5642-4d89-a26b-a6137c5a42c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:36.332480 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8b93e-5642-4d89-a26b-a6137c5a42c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:36.333904 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8b93e-5642-4d89-a26b-a6137c5a42c4 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:36.343281 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1436/2883] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:36.760256 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b9f68-91ec-47ab-aad0-80e6254e6749 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:36.761916 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-680b9f68-91ec-47ab-aad0-80e6254e6749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:36.780336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b9f68-91ec-47ab-aad0-80e6254e6749 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:36.785865 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:36.786816 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:36.787214 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:36.787541 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] PATH_INFO: `/v3/projects/0a55e411ec6b452f9e2005a1d75351d8` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:36.789199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a55e411ec6b452f9e2005a1d75351d8)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:36.791488 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:36.883833 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a55e411ec6b452f9e2005a1d75351d8', 'request_id': 'req-588867a9-7440-4cb1-921b-9765bc4fd976'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.889832 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a55e411ec6b452f9e2005a1d75351d8', 'request_id': 'req-588867a9-7440-4cb1-921b-9765bc4fd976'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.890996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:36.896874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a55e411ec6b452f9e2005a1d75351d8', 'request_id': 'req-588867a9-7440-4cb1-921b-9765bc4fd976'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.972572 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] The token cache is being invalidate because project 0a55e411ec6b452f9e2005a1d75351d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:55:36.972857 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.973460 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-588867a9-7440-4cb1-921b-9765bc4fd976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:55:36.975024 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1448/2884] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:55:36 2022] DELETE /identity/v3/projects/0a55e411ec6b452f9e2005a1d75351d8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:36.979886 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f12ce5-7cb0-4ff0-bf03-c85bb50032cf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:36.980345 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f12ce5-7cb0-4ff0-bf03-c85bb50032cf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:36.980880 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f12ce5-7cb0-4ff0-bf03-c85bb50032cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.000950 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-03f12ce5-7cb0-4ff0-bf03-c85bb50032cf None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:37.002172 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03f12ce5-7cb0-4ff0-bf03-c85bb50032cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:37.061261 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1437/2885] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:37.070044 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c0daf-9c70-4cd3-b8b1-0d03850d4356 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.070329 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c0daf-9c70-4cd3-b8b1-0d03850d4356 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.070649 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c0daf-9c70-4cd3-b8b1-0d03850d4356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.089670 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-833c0daf-9c70-4cd3-b8b1-0d03850d4356 None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:37.090895 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-833c0daf-9c70-4cd3-b8b1-0d03850d4356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:37.099174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1449/2886] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:37.103234 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f12ce5-7cb0-4ff0-bf03-c85bb50032cf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:37.113463 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f12ce5-7cb0-4ff0-bf03-c85bb50032cf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:37.118043 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:37.118666 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.118946 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.119219 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.119873 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 08:55:37.120176 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:37.121762 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:37.133022 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1438/2887] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 10 08:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 08:55:37.137134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c0daf-9c70-4cd3-b8b1-0d03850d4356 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:37.146587 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c0daf-9c70-4cd3-b8b1-0d03850d4356 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:37.151359 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a79df-f4d5-4be9-8a08-e2b638c0c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:37.151943 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a79df-f4d5-4be9-8a08-e2b638c0c56c admin admin] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.152224 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a79df-f4d5-4be9-8a08-e2b638c0c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.152525 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a79df-f4d5-4be9-8a08-e2b638c0c56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.153149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a79df-f4d5-4be9-8a08-e2b638c0c56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:37.155596 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a79df-f4d5-4be9-8a08-e2b638c0c56c admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:37.245463 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1450/2888] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 10 08:55:37 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 08:55:37.249563 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:37.259748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a511d-ed8c-4fbe-9796-f331c566383b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:37.285888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:37.316093 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdab82-c0a9-4223-9399-6445f4098a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:37.316627 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdab82-c0a9-4223-9399-6445f4098a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.317104 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdab82-c0a9-4223-9399-6445f4098a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.317610 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdab82-c0a9-4223-9399-6445f4098a08 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.318722 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdab82-c0a9-4223-9399-6445f4098a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:37.320623 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdab82-c0a9-4223-9399-6445f4098a08 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:37.403449 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1439/2889] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 10 08:55:37 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 08:55:37.408210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a79df-f4d5-4be9-8a08-e2b638c0c56c admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:37.418878 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a79df-f4d5-4be9-8a08-e2b638c0c56c admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:37.423542 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e711e6-8ac9-466d-aef7-bd2804c156f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:37.424135 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e711e6-8ac9-466d-aef7-bd2804c156f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.424413 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e711e6-8ac9-466d-aef7-bd2804c156f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.424678 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e711e6-8ac9-466d-aef7-bd2804c156f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.425358 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e711e6-8ac9-466d-aef7-bd2804c156f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:37.426984 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e711e6-8ac9-466d-aef7-bd2804c156f0 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:37.436718 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1451/2890] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:55:37.440564 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdab82-c0a9-4223-9399-6445f4098a08 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:37.450773 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdab82-c0a9-4223-9399-6445f4098a08 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:37.456038 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60198ba0-eeba-48e8-8200-edb579982c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:37.456663 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198ba0-eeba-48e8-8200-edb579982c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.456945 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198ba0-eeba-48e8-8200-edb579982c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.457220 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198ba0-eeba-48e8-8200-edb579982c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.457862 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60198ba0-eeba-48e8-8200-edb579982c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:37.459526 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60198ba0-eeba-48e8-8200-edb579982c5a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:37.469965 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1440/2891] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 10 08:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 08:55:37.473933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e711e6-8ac9-466d-aef7-bd2804c156f0 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:37.483599 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e711e6-8ac9-466d-aef7-bd2804c156f0 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:37.488100 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:37.488727 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.489001 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.489269 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] PATH_INFO: `/v3/projects/4df0ddc35b0b452db6b3ad901e7aa892/users/e04e4a6cd83b40698213d7a2c3714406/roles/4851e677104948daa4c8bcf195bd8608` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.503217 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df0ddc35b0b452db6b3ad901e7aa892, user_id=e04e4a6cd83b40698213d7a2c3714406, role_id=4851e677104948daa4c8bcf195bd8608)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:37.505840 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:37.575658 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1452/2892] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 10 08:55:37 2022] PUT /identity/v3/projects/4df0ddc35b0b452db6b3ad901e7aa892/users/e04e4a6cd83b40698213d7a2c3714406/roles/4851e677104948daa4c8bcf195bd8608 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:55:37.581257 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032248cd-810f-4e5d-9459-a3ffae91075c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.581544 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032248cd-810f-4e5d-9459-a3ffae91075c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.583664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032248cd-810f-4e5d-9459-a3ffae91075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.601412 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-032248cd-810f-4e5d-9459-a3ffae91075c None None] MFA Rules not processed for user `5a6ae8d3cbfd4ceca126228b9ed39b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:37.602664 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-032248cd-810f-4e5d-9459-a3ffae91075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:37.659813 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1441/2893] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:37.669405 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:37.671118 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:37.726334 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc9ed-c81f-419d-a080-9ce9a8037504 admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:37.730000 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:37.730628 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:37.730905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:37.731175 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:37.739965 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:37.741382 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:37.751177 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1453/2894] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:39.029343 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ba05-d8e2-400a-9ed8-e226346a53eb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:39.030436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ba05-d8e2-400a-9ed8-e226346a53eb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:39.030436 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ba05-d8e2-400a-9ed8-e226346a53eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:39.057795 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9a66ba05-d8e2-400a-9ed8-e226346a53eb None None] MFA Rules not processed for user `e04e4a6cd83b40698213d7a2c3714406`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:39.059030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9a66ba05-d8e2-400a-9ed8-e226346a53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:39.125344 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1442/2895] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:39.136127 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:39.137611 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:39.194557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8025fc8-3f21-40eb-9cc7-7df59e149e5e service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:39.198209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97401b-2608-4d4f-b0b3-019adbff77d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44743b0d10ae4b54920c821e1ef587b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:39.198935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97401b-2608-4d4f-b0b3-019adbff77d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:39.199215 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97401b-2608-4d4f-b0b3-019adbff77d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:39.199478 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97401b-2608-4d4f-b0b3-019adbff77d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:39.208174 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97401b-2608-4d4f-b0b3-019adbff77d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:39.209577 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97401b-2608-4d4f-b0b3-019adbff77d7 service cinder] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:39.218829 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1454/2896] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:40.957881 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010863d-4590-4d68-bb93-e01f4ebfd448 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:40.958396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010863d-4590-4d68-bb93-e01f4ebfd448 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:40.958396 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010863d-4590-4d68-bb93-e01f4ebfd448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:40.977335 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3010863d-4590-4d68-bb93-e01f4ebfd448 None None] MFA Rules not processed for user `e04e4a6cd83b40698213d7a2c3714406`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:55:40.978557 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3010863d-4590-4d68-bb93-e01f4ebfd448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:40.985455 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1443/2897] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:55:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:55:41.216546 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97401b-2608-4d4f-b0b3-019adbff77d7 service cinder] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:41.226011 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97401b-2608-4d4f-b0b3-019adbff77d7 service cinder] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:41.229643 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:41.230209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:41.230512 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:41.230771 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:41.232466 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:41.242828 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:41.244209 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:41.252744 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1455/2898] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:55:50.972754 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:51.248630 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:56.510888 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010863d-4590-4d68-bb93-e01f4ebfd448 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:55:56.512576 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3010863d-4590-4d68-bb93-e01f4ebfd448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:56.583384 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010863d-4590-4d68-bb93-e01f4ebfd448 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:55:56.588331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:55:56.588928 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:55:56.589229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:55:56.589497 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:55:56.591208 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:55:56.602895 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:55:56.604454 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:55:56.614912 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1444/2899] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:55:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:56:06.609922 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=32 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:33.152097 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:56:33.161331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6c94b-4b02-4c1b-ad9d-554db3bfb5c6 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:56:33.164905 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:56:33.165483 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:56:33.165758 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:56:33.166020 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:56:33.167749 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:56:33.226210 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:56:33.227580 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:56:33.236591 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1456/2900] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:56:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:56:34.742487 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:56:34.752617 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe290-21ac-46bf-95ac-7d21d8338703 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:56:34.756179 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:56:34.756748 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:56:34.757048 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:56:34.757314 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:56:34.759035 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:56:34.835369 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:56:34.836820 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:56:34.848414 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1445/2901] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:56:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:56:36.029567 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:56:36.030996 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:56:36.042451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85663ff-05de-455a-9bc1-d10e7b73e2eb service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:56:36.046170 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:56:36.046657 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:56:36.046937 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:56:36.047199 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:56:36.049490 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:56:36.062321 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:56:36.063844 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:56:36.074581 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1457/2902] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:56:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:56:44.359195 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:56:44.368952 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a9780-d29f-4363-92c7-2d3b416d70ba service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:56:44.372719 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:56:44.373318 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:56:44.373595 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:56:44.373865 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:56:44.375803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:56:44.387805 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:56:44.389222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:56:44.399451 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1446/2903] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:56:46.069799 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=34 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:51.824435 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:56:51.825935 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:56:51.840110 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f7582-7395-4b57-9c8e-9cec6d6a55cd service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:56:51.844659 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:56:51.845278 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:56:51.845557 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:56:51.845830 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] PATH_INFO: `/v3/users/1fefe615c29f4a8290c81ec430f8d9ae` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:56:51.846971 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fefe615c29f4a8290c81ec430f8d9ae)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:56:51.848876 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:56:52.059122 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fefe615c29f4a8290c81ec430f8d9ae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.064336 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fefe615c29f4a8290c81ec430f8d9ae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.120973 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fefe615c29f4a8290c81ec430f8d9ae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.121585 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fefe615c29f4a8290c81ec430f8d9ae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.135040 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fefe615c29f4a8290c81ec430f8d9ae'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.141259 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1458/2904] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:56:51 2022] DELETE /identity/v3/users/1fefe615c29f4a8290c81ec430f8d9ae => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:56:52.432094 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:56:52.442699 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb408829-bdcf-4339-a3ad-27132006a6ce service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:56:52.501909 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:56:52.502456 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:56:52.502757 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:56:52.503026 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] PATH_INFO: `/v3/projects/2788e89ec8a54cf0812124e6ce142061` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:56:52.504146 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] RBAC: Authorizing `identity:delete_project(project_id=2788e89ec8a54cf0812124e6ce142061)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:56:52.506024 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:56:52.611259 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2788e89ec8a54cf0812124e6ce142061', 'request_id': 'req-91656638-dcc7-4137-8d43-1834b67908da'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.657803 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2788e89ec8a54cf0812124e6ce142061', 'request_id': 'req-91656638-dcc7-4137-8d43-1834b67908da'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.664082 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2788e89ec8a54cf0812124e6ce142061', 'request_id': 'req-91656638-dcc7-4137-8d43-1834b67908da'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.675222 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] The token cache is being invalidate because project 2788e89ec8a54cf0812124e6ce142061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:56:52.675501 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.676124 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.677588 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1447/2905] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:56:52 2022] DELETE /identity/v3/projects/2788e89ec8a54cf0812124e6ce142061 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:56:52.681637 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:56:52.683103 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:56:52.696941 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dc7c0-f870-4732-ac0f-64eefa7405cc admin admin] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:56:52.753049 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:56:52.753589 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:56:52.753866 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:56:52.754138 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] PATH_INFO: `/v3/users/e5d12016c5db401a8c002bbed34fabc0` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:56:52.755385 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d12016c5db401a8c002bbed34fabc0)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:56:52.757302 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:56:52.940043 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d12016c5db401a8c002bbed34fabc0'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:52.947184 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d12016c5db401a8c002bbed34fabc0'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.012222 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d12016c5db401a8c002bbed34fabc0'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.012988 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d12016c5db401a8c002bbed34fabc0'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.022228 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:53.026927 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-2f9b57db-e59e-4818-8e1e-be9a82cca1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d12016c5db401a8c002bbed34fabc0'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.033396 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1459/2906] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:56:52 2022] DELETE /identity/v3/users/e5d12016c5db401a8c002bbed34fabc0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:56:53.308726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:56:53.308726 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:56:53.318044 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:53.322308 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91656638-dcc7-4137-8d43-1834b67908da admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:56:53.387693 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:56:53.388337 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:56:53.388618 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:56:53.389023 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] PATH_INFO: `/v3/projects/be816ca2a5ee4354a7bc50141641b230` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:56:53.390030 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=be816ca2a5ee4354a7bc50141641b230)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:56:53.392578 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:56:53.509288 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be816ca2a5ee4354a7bc50141641b230', 'request_id': 'req-7f220830-9763-4c68-92d1-31080c6674ab'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.606837 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be816ca2a5ee4354a7bc50141641b230', 'request_id': 'req-7f220830-9763-4c68-92d1-31080c6674ab'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.613911 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be816ca2a5ee4354a7bc50141641b230', 'request_id': 'req-7f220830-9763-4c68-92d1-31080c6674ab'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.624013 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] The token cache is being invalidate because project be816ca2a5ee4354a7bc50141641b230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:56:53.624303 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.625590 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:56:53.627123 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1448/2907] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:56:53 2022] DELETE /identity/v3/projects/be816ca2a5ee4354a7bc50141641b230 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:57:03.326855 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:03.636597 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:03.890508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192e4e-9aba-4ee0-8631-862028854456 None None] REQUEST_METHOD: `POST` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:57:03.890734 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192e4e-9aba-4ee0-8631-862028854456 None None] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:57:03.891004 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192e4e-9aba-4ee0-8631-862028854456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:57:03.910737 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.auth.core [None req-2d192e4e-9aba-4ee0-8631-862028854456 None None] MFA Rules not processed for user `e04e4a6cd83b40698213d7a2c3714406`. Rule list: `[]` (Enabled: `True`). {{(pid=80417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 08:57:03.911933 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2d192e4e-9aba-4ee0-8631-862028854456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:57:03.966562 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1460/2908] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 10 08:57:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 08:57:04.459718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:57:04.461194 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:57:04.516111 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f220830-9763-4c68-92d1-31080c6674ab admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:57:04.529107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:57:04.529107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:57:04.529107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:57:04.529107 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:57:04.529559 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:57:04.532306 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:57:04.533717 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:57:04.541608 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1449/2909] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:57:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:57:07.789674 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192e4e-9aba-4ee0-8631-862028854456 None None] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:57:07.791130 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-2d192e4e-9aba-4ee0-8631-862028854456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:57:07.803874 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192e4e-9aba-4ee0-8631-862028854456 None None] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:57:07.807619 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80c8c0985f6847368c4f7263b2bf8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:57:07.808242 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] REQUEST_METHOD: `GET` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:57:07.808515 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:57:07.808781 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:57:07.810444 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.fernet_utils [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:57:07.820331 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:57:07.823784 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:57:07.829616 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1461/2910] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 08:57:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 08:57:14.537999 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=26 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:17.826149 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=31 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:58:16.628581 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:58:16.630645 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 08:58:16.698118 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f3b1c-ad73-4c0d-96e2-f30b44360918 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:58:16.702601 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:58:16.703229 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:58:16.703507 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:58:16.703777 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] PATH_INFO: `/v3/users/e04e4a6cd83b40698213d7a2c3714406` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:58:16.704901 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04e4a6cd83b40698213d7a2c3714406)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:58:16.706885 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:58:16.863494 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04e4a6cd83b40698213d7a2c3714406'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:16.930102 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04e4a6cd83b40698213d7a2c3714406'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:16.937485 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04e4a6cd83b40698213d7a2c3714406'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:16.949718 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04e4a6cd83b40698213d7a2c3714406'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:16.950331 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04e4a6cd83b40698213d7a2c3714406'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:16.956138 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1450/2911] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 10 08:58:16 2022] DELETE /identity/v3/users/e04e4a6cd83b40698213d7a2c3714406 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:58:17.199414 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] Authenticating user token {{(pid=80417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 08:58:17.211508 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926d713-1e2d-4486-854f-f8b4de220298 service neutron] Validating token access rules against request {{(pid=80417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 08:58:17.266798 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ae8d3cbfd4ceca126228b9ed39b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4075a07229a44c19829adfecb306b6b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 08:58:17.267419 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 08:58:17.267693 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 08:58:17.267958 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] PATH_INFO: `/v3/projects/4df0ddc35b0b452db6b3ad901e7aa892` {{(pid=80417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 08:58:17.269068 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df0ddc35b0b452db6b3ad901e7aa892)` {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 08:58:17.271479 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] RBAC: Authorization granted {{(pid=80417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 08:58:17.386889 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df0ddc35b0b452db6b3ad901e7aa892', 'request_id': 'req-115c5006-9d06-4db2-9607-bdd6a08787d3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:17.392257 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df0ddc35b0b452db6b3ad901e7aa892', 'request_id': 'req-115c5006-9d06-4db2-9607-bdd6a08787d3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:17.398752 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df0ddc35b0b452db6b3ad901e7aa892', 'request_id': 'req-115c5006-9d06-4db2-9607-bdd6a08787d3'} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:17.466134 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] The token cache is being invalidate because project 4df0ddc35b0b452db6b3ad901e7aa892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 08:58:17.466398 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:17.466985 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG keystone.notifications [None req-115c5006-9d06-4db2-9607-bdd6a08787d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 08:58:17.468451 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: [pid: 80417|app: 0|req: 1462/2912] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 10 08:58:17 2022] DELETE /identity/v3/projects/4df0ddc35b0b452db6b3ad901e7aa892 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 08:58:26.952652 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:58:27.463061 dv-cinder-781024-3-iscsi devstack@keystone.service[80417]: DEBUG dbcounter [-] [80417] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:00:58.487724 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:00:58.489186 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:00:58.633566 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbedab-51a4-4861-927c-fbde04eb7fbc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:00:58.693341 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39d8d2-5569-41cf-b6a1-621dd59a3a89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f08c0a99674a849035dc0b44e62e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bada15b997f4ff881215a35b1569324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:00:58.693969 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39d8d2-5569-41cf-b6a1-621dd59a3a89 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:00:58.694235 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39d8d2-5569-41cf-b6a1-621dd59a3a89 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:00:58.694537 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39d8d2-5569-41cf-b6a1-621dd59a3a89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:00:58.696289 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3a39d8d2-5569-41cf-b6a1-621dd59a3a89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:00:58.707916 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39d8d2-5569-41cf-b6a1-621dd59a3a89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:00:58.709671 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39d8d2-5569-41cf-b6a1-621dd59a3a89 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:00:58.720371 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1451/2913] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 10 09:00:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:01:08.715317 dv-cinder-781024-3-iscsi devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}